How To: Increasing the Socket Read Timeout in VCF Automation Orchestration

What is the Issue?

At times steps in a VCF Automation Orchestrator workflow may take some time to complete. For example, a rescan job during the "Create VMFS Datastore on a new FlashArray Volume" Workflow.

Should the rescan take longer than 1 minute (the default read timeout) to complete, then the Workflow will fail. For example:


[2019-01-15 11:29:22.521] [I] Volume object "bootcamp-alex-vro-ds-1" created successfully!
[2019-01-15 11:29:22.967] [I] Volume: 'bootcamp-alex-vro-ds-1' Connected to Host Group: 'bootcamp-alex-esxi-cluster-1'
[2019-01-15 11:30:23.078] [E] (com.vmware.library.vc.storage/rescanAll) Error in (Dynamic Script Module name : rescanAll#1) java.net.SocketTimeoutException: Read timed out
[2019-01-15 11:30:23.577] [I] Volume "bootcamp-alex-vro-ds-1" deleted successfully
[2019-01-15 11:30:23.955] [I] Volume object "bootcamp-alex-vro-ds-1" eradicated successfully!
[2019-01-15 11:30:23.988] [E] Workflow execution stack:
***
item: 'Create VMFS Datastore on new FlashArray Volume./item11', state: 'failed', business state: 'null', exception: 'java.net.SocketTimeoutException: Read timed out (Dynamic Script Module name : rescanAll#1)'
workflow: 'Create VMFS Datastore on new FlashArray Volume.' (9b3e69aa-8e5b-4545-8316-166eb5ef0b28) 
|  'attribute': name=hosts type=Array/VC:HostSystem value=#{#VC:HostSystem#dunes://service.dunes.ch/CustomSDKObject?id='Bootcamp-vcsa-1.dev.purestorage.com%2Cid:host-38'&dunesName='VC:HostSystem'#;#VC:HostSystem#dunes://service.dunes.ch/CustomSDKObject?id='Bootcamp-vcsa-1.dev.purestorage.com%2Cid:host-30'&dunesName='VC:HostSystem'#}#
|  'attribute': name=result type=Array/PS:Host value=#{#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::UCS-BLADE-1-FC'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::UCS-BLADE-1-iSCSI'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::UCS-BLADE-2-FC'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::UCS-BLADE-2-iSCSI'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::UCS-BLADE-3-FC'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::UCS-BLADE-3-iSCSI'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::UCS-BLADE-4-FC'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::UCS-BLADE-4-iSCSI'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::UCS-BLADE-5-FC'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::UCS-BLADE-5-iSCSI'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::UCS-BLADE-6-FC'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::UCS-BLADE-6-iSCSI'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::UCS-BLADE-7-FC'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::UCS-BLADE-7-iSCSI'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::UCS-BLADE-8-FC'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::UCS-BLADE-8-iSCSI'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-alex-esxi-1'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-alex-esxi-2'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-alex-esxi-3'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-alex-esxi-4'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-eddie-esxi-1'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-eddie-esxi-2'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-eddie-esxi-3'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-eddie-esxi-4'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-brent-esxi-1'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-brent-esxi-2'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-brent-esxi-3'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-brent-esxi-4'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-shawn-esxi-1'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-shawn-esxi-2'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-shawn-esxi-3'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-shawn-esxi-4'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-jlarson-esx-1'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-jlarson-esx-2'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-jlarson-esx-3'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-jlarson-esx-4'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-Mike-ESXi-2'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-Mike-ESXi-3'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-Mike-ESXi-4'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-Mike-ESXi-1'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-philip-esxi-1'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-philip-esxi-2'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-philip-esxi-3'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-philip-esxi-4'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-hatchett-esxi-1'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-hatchett-esxi-2'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-hatchett-esxi-3'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-hatchett-esxi-4'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-ryan-ESXi-1'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-ryan-ESXi-2'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-ryan-ESXi-3'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-ryan-ESXi-4'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-johnathan-esxi-1'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-johnathan-esxi-2'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-johnathan-esxi-3'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-johnathan-esxi-4'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-luis-esxi-1'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-luis-esxi-2'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-luis-esxi-3'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-luis-esxi-4'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-Darren-ESXi-1'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-Darren-ESXi-2'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-Darren-ESXi-3'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-Darren-ESXi-4'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-Rika-esxi-1'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-Rika-esxi-02'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-Rika-esxi-3'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-Rika-esxi-4'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-Matt-esxi-1'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-Matt-esxi-2'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-Matt-esxi-3'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::Bootcamp-Matt-esxi-4'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-nelson-esxi-1'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-nelson-esxi-2'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-nelson-esxi-3'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-nelson-esxi-4'&dunesName='PS:Host'#}#
|  'attribute': name=hostResults type=Array/string value=#{#string#bootcamp-alex-esxi-2#;#string#bootcamp-alex-esxi-1#}#
|  'attribute': name=flashArrayHosts type=Array/PS:Host value=#{#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-alex-esxi-2'&dunesName='PS:Host'#;#PS:Host#dunes://service.dunes.ch/CustomSDKObject?id='SLC-OOTO::bootcamp-alex-esxi-1'&dunesName='PS:Host'#}#
|  'attribute': name=hgroupName type=string value=bootcamp-alex-esxi-cluster-1

The Key part is this Error Line:


[2019-01-15 11:30:23.078] [E] (com.vmware.library.vc.storage/rescanAll) Error in (Dynamic Script Module name : rescanAll#1) java.net.SocketTimeoutException: Read timed out

Should this be causing workflows to fail, a possible solution is to increase the SocketReadTimeout value from the default 1 minute to something sufficiently long, such as 5 minutes.