Distributed solver

  • 180 Views
  • Last Post 20 October 2019
  • Topic Is Solved
kolyan007 posted this 28 September 2019

Hello,

I'm playing with Distributed solving in version 19.4 R2. My cluster has 3 PCs. In a couple minutes after Solver started the job has failed.

I can't find what caused it. Could you please review log file and advise?

Thanks, Nick

Attached Files

Order By: Standard | Newest | Votes
kolyan007 posted this 20 October 2019

Thanks Jake, I got it working with IBM MPI and non-localhost HPC resource. All good now

jcallery posted this 14 October 2019

Please go to the staging directory from the command line on maincad (using the local path/drive letter) and run the following from the command line:

 C:\Program Files\ANSYS Inc\v195\ansys\bin\winx64\ANSYS195.exe -b nolist -s noread -p ansys -mpi intelmpi -i remote.dat -o solve.out -dis -machines maincad:4:cluster01:4:cluster02:4 -dir "//MainCAD/RSMStaging/eubgp21n.ezb"

Please send a screenshot of the output.

 

Also make sure that IntelMPI is installed on all machines, and that you have cached the IntelMPI password on each machine.

Are these machines on domain? (It doesn't look like it from the log)

 

You could also try IBM MPI instead of IntelMPI (that won't require a password to be cached)

To do that, go into the Mechanical Solve Process Settings, select the setting you are using to submit the job with, click Advanced...

In "Additional Command line arguments" enter:

-mpi ibmmpi

 

Then try resubmitting.

Make sure that IBM MPI is installed on each machine.

If it is not, you can run the installer from:

C:\Program Files\ANSYS Inc\v195\commonfiles\MPI\IBM\9.1.4.5\Windows\Platform_MPI-9.1.4.5-hpc.x64.exe

 

Thank you,

Jake

kolyan007 posted this 12 October 2019

Thank you Jake. The UNC has been disabled on all machines using steps above.

See below my RSM configuration settings for localhost on Submit Host and most recent error log. Please advise what else is wrong in my configuration.

 

 

1     13/10/2019 12:01:15 am     RSM Version: 19.5.420.0, Build Date: 30/07/2019 57:06 am
2     13/10/2019 12:01:15 am     RSM File Version: 19.5.0-beta.3+Branch.release-19.5.Sha.9c15e0a3e0a608e8efe8c568e494d2160788d025
3     13/10/2019 12:01:15 am     RSM Library Version: 19.5.0.0
4     13/10/2019 12:01:15 am     Job Name: Annulus_Thread_MAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)
5     13/10/2019 12:01:15 am        Type: Mechanical_ANSYS
6     13/10/2019 12:01:15 am        Client Directory: C:\TestProject - Copy - Copy\_ProjectScratch\Scr1E08\
7     13/10/2019 12:01:15 am        Client Machine: Maincad
8     13/10/2019 12:01:15 am        Queue: Default [localhost, default]
9     13/10/2019 12:01:15 am        Template: Mechanical_ANSYSJob.xml
10     13/10/2019 12:01:15 am     Cluster Configuration: localhost [localhost]
11     13/10/2019 12:01:15 am        Cluster Type: ARC
12     13/10/2019 12:01:15 am        Custom Keyword: blank
13     13/10/2019 12:01:15 am        Transfer Option: NativeOS
14     13/10/2019 12:01:15 am        Staging Directory: \\MainCAD\RSMStaging
15     13/10/2019 12:01:15 am        Delete Staging Directory: True
16     13/10/2019 12:01:15 am        Local Scratch Directory: blank
17     13/10/2019 12:01:15 am        Platform: Windows
18     13/10/2019 12:01:15 am        Cluster Submit Options: blank
19     13/10/2019 12:01:15 am        Normal Inputs: [*.dat,file*.*,*.mac,thermal.build,commands.xml,SecInput.txt]
20     13/10/2019 12:01:15 am        Cancel Inputs: [file.abt,sec.interrupt]
21     13/10/2019 12:01:15 am        Excluded Inputs: [-]
22     13/10/2019 12:01:15 am        Normal Outputs: [*.xml,*.NR*,CAERepOutput.xml,cyclic_map.json,exit.topo,file*.dsub,file*.ldhi,file*.png,file*.r0*,file*.r1*,file*.r2*,file*.r3*,file*.r4*,file*.r5*,file*.r6*,file*.r7*,file*.r8*,file*.r9*,file*.rd*,file*.rst,file.BCS,file.ce,file.cm,file.cnd,file.cnm,file.DSP,file.err,file.gst,file.json,file.nd*,file.nlh,file.nr*,file.PCS,file.rdb,file.rfl,file.spm,file0.BCS,file0.ce,file0.cnd,file0.err,file0.gst,file0.nd*,file0.nlh,file0.nr*,file0.PCS,frequencies_*.out,input.x17,intermediate*.topo,Mode_mapping_*.txt,NotSupportedElems.dat,ObjectiveHistory.out,post.out,PostImage*.png,record.txt,solve*.out,topo.err,toput,vars.topo,SecDebugLog.txt,secStart.log,sec.validation.executed,sec.envvarvalidation.executed,sec.failure]
23     13/10/2019 12:01:15 am        Failure Outputs: [*.xml,*.NR*,CAERepOutput.xml,cyclic_map.json,exit.topo,file*.dsub,file*.ldhi,file*.png,file*.r0*,file*.r1*,file*.r2*,file*.r3*,file*.r4*,file*.r5*,file*.r6*,file*.r7*,file*.r8*,file*.r9*,file*.rd*,file*.rst,file.BCS,file.ce,file.cm,file.cnd,file.cnm,file.DSP,file.err,file.gst,file.json,file.nd*,file.nlh,file.nr*,file.PCS,file.rdb,file.rfl,file.spm,file0.BCS,file0.ce,file0.cnd,file0.err,file0.gst,file0.nd*,file0.nlh,file0.nr*,file0.PCS,frequencies_*.out,input.x17,intermediate*.topo,Mode_mapping_*.txt,NotSupportedElems.dat,ObjectiveHistory.out,post.out,PostImage*.png,record.txt,solve*.out,topo.err,toput,vars.topo,SecDebugLog.txt,sec.solverexitcode,secStart.log,sec.failure,sec.envvarvalidation.executed]
24     13/10/2019 12:01:15 am        Cancel Outputs: [file*.err,solve.out,secStart.log,SecDebugLog.txt]
25     13/10/2019 12:01:15 am        Excluded Outputs: [-]
26     13/10/2019 12:01:15 am        Inquire Files:
27     13/10/2019 12:01:15 am          normal: [*.xml,*.NR*,CAERepOutput.xml,cyclic_map.json,exit.topo,file*.dsub,file*.ldhi,file*.png,file*.r0*,file*.r1*,file*.r2*,file*.r3*,file*.r4*,file*.r5*,file*.r6*,file*.r7*,file*.r8*,file*.r9*,file*.rd*,file*.rst,file.BCS,file.ce,file.cm,file.cnd,file.cnm,file.DSP,file.err,file.gst,file.json,file.nd*,file.nlh,file.nr*,file.PCS,file.rdb,file.rfl,file.spm,file0.BCS,file0.ce,file0.cnd,file0.err,file0.gst,file0.nd*,file0.nlh,file0.nr*,file0.PCS,frequencies_*.out,input.x17,intermediate*.topo,Mode_mapping_*.txt,NotSupportedElems.dat,ObjectiveHistory.out,post.out,PostImage*.png,record.txt,solve*.out,topo.err,toput,vars.topo,SecDebugLog.txt,secStart.log,sec.validation.executed,sec.envvarvalidation.executed,sec.failure]
28     13/10/2019 12:01:15 am          cancel: [file*.err,solve.out,secStart.log,SecDebugLog.txt]
29     13/10/2019 12:01:15 am          failure: [*.xml,*.NR*,CAERepOutput.xml,cyclic_map.json,exit.topo,file*.dsub,file*.ldhi,file*.png,file*.r0*,file*.r1*,file*.r2*,file*.r3*,file*.r4*,file*.r5*,file*.r6*,file*.r7*,file*.r8*,file*.r9*,file*.rd*,file*.rst,file.BCS,file.ce,file.cm,file.cnd,file.cnm,file.DSP,file.err,file.gst,file.json,file.nd*,file.nlh,file.nr*,file.PCS,file.rdb,file.rfl,file.spm,file0.BCS,file0.ce,file0.cnd,file0.err,file0.gst,file0.nd*,file0.nlh,file0.nr*,file0.PCS,frequencies_*.out,input.x17,intermediate*.topo,Mode_mapping_*.txt,NotSupportedElems.dat,ObjectiveHistory.out,post.out,PostImage*.png,record.txt,solve*.out,topo.err,toput,vars.topo,SecDebugLog.txt,sec.solverexitcode,secStart.log,sec.failure,sec.envvarvalidation.executed]
30     13/10/2019 12:01:15 am          RemotePostInformation: [RemotePostInformation.txt]
31     13/10/2019 12:01:15 am          SolutionInformation: [solve.out,file.gst,file.nlh,file0.gst,file0.nlh,file.cnd]
32     13/10/2019 12:01:15 am          PostDuringSolve: [file.rcn,file.redm,file.rfl,file.rfrq,file.rmg,file.rdsp,file.rsx,file.rst,file.rth,solve.out,file.gst,file.nlh,file0.gst,file0.nlh,file.cnd]
33     13/10/2019 12:01:15 am          transcript: [solve.out,monitor.json]
34     13/10/2019 12:01:15 am     Submission in progress...
35     13/10/2019 12:01:15 am     Created storage directory \\MainCAD\RSMStaging\eubgp21n.ezb
36     13/10/2019 12:01:15 am     Runtime Settings:
37     13/10/2019 12:01:15 am        Job Owner: MAINCAD\User
38     13/10/2019 12:01:15 am        Submit Time: Sunday, 13 October 2019 12:01 am
39     13/10/2019 12:01:15 am        Directory: \\MainCAD\RSMStaging\eubgp21n.ezb
40     13/10/2019 12:01:15 am     File Transfer Package: Upload to localhost:0
41     13/10/2019 12:01:15 am        Name: RSM_Upload_During_Submit
42     13/10/2019 12:01:15 am        Local Directory: C:\TestProject - Copy - Copy\_ProjectScratch\Scr1E08\
43     13/10/2019 12:01:15 am        Storage Path: \\MainCAD\RSMStaging\eubgp21n.ezb
44     13/10/2019 12:01:15 am        Storage Location:
45     13/10/2019 12:01:15 am        Files: [*.dat,file*.*,*.mac,thermal.build,commands.xml,SecInput.txt]
46     13/10/2019 12:01:15 am        Exclude: [-]
47     13/10/2019 12:01:15 am     Storage contents:
48     13/10/2019 12:01:15 am     Uploading file: C:\TestProject - Copy - Copy\_ProjectScratch\Scr1E08\ds.dat
49     13/10/2019 12:01:15 am     Copying C:\TestProject - Copy - Copy\_ProjectScratch\Scr1E08\ds.dat to //MainCAD/RSMStaging/eubgp21n.ezb/ds.dat
50     13/10/2019 12:01:15 am            File size: 39897206 bytes,  transferred: 39897206 bytes.
51     13/10/2019 12:01:15 am     Uploading file: C:\TestProject - Copy - Copy\_ProjectScratch\Scr1E08\remote.dat
52     13/10/2019 12:01:15 am     Copying C:\TestProject - Copy - Copy\_ProjectScratch\Scr1E08\remote.dat to //MainCAD/RSMStaging/eubgp21n.ezb/remote.dat
53     13/10/2019 12:01:15 am            File size: 179 bytes,  transferred: 179 bytes.
54     13/10/2019 12:01:15 am     Uploading file: C:\TestProject - Copy - Copy\_ProjectScratch\Scr1E08\commands.xml
55     13/10/2019 12:01:15 am     Copying C:\TestProject - Copy - Copy\_ProjectScratch\Scr1E08\commands.xml to //MainCAD/RSMStaging/eubgp21n.ezb/commands.xml
56     13/10/2019 12:01:15 am            File size: 477 bytes,  transferred: 477 bytes.
57     13/10/2019 12:01:15 am     Uploading file: C:\TestProject - Copy - Copy\_ProjectScratch\Scr1E08\SecInput.txt
58     13/10/2019 12:01:15 am     Copying C:\TestProject - Copy - Copy\_ProjectScratch\Scr1E08\SecInput.txt to //MainCAD/RSMStaging/eubgp21n.ezb/SecInput.txt
59     13/10/2019 12:01:15 am            File size: 899 bytes,  transferred: 899 bytes.
60     13/10/2019 12:01:15 am     Storage contents:
61     13/10/2019 12:01:15 am        ds.dat
62     13/10/2019 12:01:15 am        remote.dat
63     13/10/2019 12:01:15 am        commands.xml
64     13/10/2019 12:01:15 am        SecInput.txt
65     13/10/2019 12:01:15 am     39898.76 KB, .11 sec (364870.74 KB/sec)
66     13/10/2019 12:01:15 am     Submission in progress...
67     13/10/2019 12:01:15 am     Commands from commands.xml file
68     13/10/2019 12:01:15 am     Behavior code: Ansys.Rsm.ClusterOperations.Behaviors.MechanicalAnsysBehaviors
69     13/10/2019 12:01:15 am     Loading Cluster Customization file C:\Program Files\ANSYS Inc\v195\RSM\Config\xml\ClusterJobCustomization.xml.
70     13/10/2019 12:01:15 am     No customization found for cluster machineName Maincad, type ARC
71     13/10/2019 12:01:15 am     HPC Commands Files Used:
72     13/10/2019 12:01:15 am        hpc_commands_ARC.xml
73     13/10/2019 12:01:15 am     Environment variables:
74     13/10/2019 12:01:15 am        RSM_PYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python
75     13/10/2019 12:01:15 am        RSM_IRON_PYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython
76     13/10/2019 12:01:15 am        RSM_PYTHON_EXE=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python\python.exe
77     13/10/2019 12:01:15 am        RSM_TASK_WORKING_DIRECTORY=\\MainCAD\RSMStaging\eubgp21n.ezb
78     13/10/2019 12:01:15 am        RSM_USE_SSH_LINUX=False
79     13/10/2019 12:01:15 am        RSM_QUEUE_NAME=default
80     13/10/2019 12:01:15 am        RSM_CONFIGUREDQUEUE_NAME=Default
81     13/10/2019 12:01:15 am        RSM_COMPUTE_SERVER_MACHINE_NAME=Maincad
82     13/10/2019 12:01:15 am        RSM_HPC_JOBNAME=Mechanical
83     13/10/2019 12:01:15 am        RSM_HPC_DISPLAYNAME=Annulus_Thread_MAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)
84     13/10/2019 12:01:15 am        RSM_HPC_CORES=12
85     13/10/2019 12:01:15 am        RSM_HPC_DISTRIBUTED=TRUE
86     13/10/2019 12:01:15 am        RSM_HPC_NODE_EXCLUSIVE=FALSE
87     13/10/2019 12:01:15 am        RSM_HPC_QUEUE=default
88     13/10/2019 12:01:15 am        RSM_HPC_USER=MAINCAD\User
89     13/10/2019 12:01:15 am        RSM_HPC_WORKDIR=\\MainCAD\RSMStaging\eubgp21n.ezb
90     13/10/2019 12:01:15 am        RSM_HPC_JOBTYPE=Mechanical_ANSYS
91     13/10/2019 12:01:15 am        RSM_HPC_ANSYS_LOCAL_INSTALL_DIRECTORY=C:\Program Files\ANSYS Inc\v195
92     13/10/2019 12:01:15 am        RSM_HPC_VERSION=195
93     13/10/2019 12:01:15 am        RSM_HPC_STAGING=\\MainCAD\RSMStaging\eubgp21n.ezb
94     13/10/2019 12:01:15 am        RSM_HPC_LOCAL_PLATFORM=Windows
95     13/10/2019 12:01:15 am        RSM_HPC_CLUSTER_TARGET_PLATFORM=Windows
96     13/10/2019 12:01:15 am        RSM_HPC_STDOUTFILE=stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
97     13/10/2019 12:01:15 am        RSM_HPC_STDERRFILE=stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
98     13/10/2019 12:01:15 am        RSM_HPC_STDOUTLIVE=stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
99     13/10/2019 12:01:15 am        RSM_HPC_STDERRLIVE=stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
100     13/10/2019 12:01:15 am        RSM_HPC_SCRIPTS_DIRECTORY_LOCAL=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts
101     13/10/2019 12:01:15 am        RSM_HPC_SCRIPTS_DIRECTORY=%AWP_ROOT195%\RSM\Config\scripts
102     13/10/2019 12:01:15 am        RSM_HPC_SUBMITHOST=localhost
103     13/10/2019 12:01:15 am        RSM_HPC_STORAGEID=<JobId>    <id>2e240152-9c98-4c8b-b806-5ccbbda6db14</id>    <nativeId>Mechanical=LocalOS#localhost$\\MainCAD\RSMStaging\eubgp21n.ezb</nativeId>    <timestamp>Saturday, October 12, 2019 11:01:15.288 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>
104     13/10/2019 12:01:15 am        RSM_HPC_PLATFORMSTORAGEID=\\MainCAD\RSMStaging\eubgp21n.ezb
105     13/10/2019 12:01:15 am        RSM_HPC_NATIVEOPTIONS=
106     13/10/2019 12:01:15 am        ARC_ROOT=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts\..\..\ARC
107     13/10/2019 12:01:15 am        RSM_HPC_KEYWORD=ARC
108     13/10/2019 12:01:15 am     JobType is: Mechanical_ANSYS
109     13/10/2019 12:01:15 am     Final command platform: Windows
110     13/10/2019 12:01:15 am     RSM_PYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python
111     13/10/2019 12:01:15 am     RSM_HPC_JOBNAME=Mechanical
112     13/10/2019 12:01:15 am     Distributed mode requested: True
113     13/10/2019 12:01:15 am     RSM_HPC_DISTRIBUTED=TRUE
114     13/10/2019 12:01:15 am     Running 1 commands
115     13/10/2019 12:01:15 am     Job working directory: \\MainCAD\RSMStaging\eubgp21n.ezb
116     13/10/2019 12:01:15 am     Number of CPU requested: 12
117     13/10/2019 12:01:15 am     AWP_ROOT195=C:\Program Files\ANSYS Inc\v195
118     13/10/2019 12:01:15 am     Checking queue default exists ...
119     13/10/2019 12:01:15 am     External cluster command: queryQueues ---------------------------------------
120     13/10/2019 12:01:15 am        Cluster command before expansion: %ARC_ROOT%\bin\ArcQueues.exe
121     13/10/2019 12:01:15 am        Final cluster command: C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts\..\..\ARC\bin\ArcQueues.exe
122     13/10/2019 12:01:15 am        Working directory : \\MainCAD\RSMStaging\eubgp21n.ezb
123     13/10/2019 12:01:15 am        Variables:
124     13/10/2019 12:01:15 am            RSM_PYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python
125     13/10/2019 12:01:15 am            RSM_IRON_PYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython
126     13/10/2019 12:01:15 am            RSM_PYTHON_EXE=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python\python.exe
127     13/10/2019 12:01:15 am            RSM_TASK_WORKING_DIRECTORY=\\MainCAD\RSMStaging\eubgp21n.ezb
128     13/10/2019 12:01:15 am            RSM_USE_SSH_LINUX=False
129     13/10/2019 12:01:15 am            RSM_QUEUE_NAME=default
130     13/10/2019 12:01:15 am            RSM_CONFIGUREDQUEUE_NAME=Default
131     13/10/2019 12:01:15 am            RSM_COMPUTE_SERVER_MACHINE_NAME=Maincad
132     13/10/2019 12:01:15 am            RSM_HPC_JOBNAME=Mechanical
133     13/10/2019 12:01:15 am            RSM_HPC_DISPLAYNAME=Annulus_Thread_MAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)
134     13/10/2019 12:01:15 am            RSM_HPC_CORES=12
135     13/10/2019 12:01:15 am            RSM_HPC_DISTRIBUTED=TRUE
136     13/10/2019 12:01:15 am            RSM_HPC_NODE_EXCLUSIVE=FALSE
137     13/10/2019 12:01:15 am            RSM_HPC_QUEUE=default
138     13/10/2019 12:01:15 am            RSM_HPC_USER=MAINCAD\User
139     13/10/2019 12:01:15 am            RSM_HPC_WORKDIR=\\MainCAD\RSMStaging\eubgp21n.ezb
140     13/10/2019 12:01:15 am            RSM_HPC_JOBTYPE=Mechanical_ANSYS
141     13/10/2019 12:01:15 am            RSM_HPC_ANSYS_LOCAL_INSTALL_DIRECTORY=C:\Program Files\ANSYS Inc\v195
142     13/10/2019 12:01:15 am            RSM_HPC_VERSION=195
143     13/10/2019 12:01:15 am            RSM_HPC_STAGING=\\MainCAD\RSMStaging\eubgp21n.ezb
144     13/10/2019 12:01:15 am            RSM_HPC_LOCAL_PLATFORM=Windows
145     13/10/2019 12:01:15 am            RSM_HPC_CLUSTER_TARGET_PLATFORM=Windows
146     13/10/2019 12:01:15 am            RSM_HPC_STDOUTFILE=stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
147     13/10/2019 12:01:15 am            RSM_HPC_STDERRFILE=stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
148     13/10/2019 12:01:15 am            RSM_HPC_STDOUTLIVE=stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
149     13/10/2019 12:01:15 am            RSM_HPC_STDERRLIVE=stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
150     13/10/2019 12:01:15 am            RSM_HPC_SCRIPTS_DIRECTORY_LOCAL=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts
151     13/10/2019 12:01:15 am            RSM_HPC_SCRIPTS_DIRECTORY=%AWP_ROOT195%\RSM\Config\scripts
152     13/10/2019 12:01:15 am            RSM_HPC_SUBMITHOST=localhost
153     13/10/2019 12:01:15 am            RSM_HPC_STORAGEID=<JobId>    <id>2e240152-9c98-4c8b-b806-5ccbbda6db14</id>    <nativeId>Mechanical=LocalOS#localhost$\\MainCAD\RSMStaging\eubgp21n.ezb</nativeId>    <timestamp>Saturday, October 12, 2019 11:01:15.288 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>
154     13/10/2019 12:01:15 am            RSM_HPC_PLATFORMSTORAGEID=\\MainCAD\RSMStaging\eubgp21n.ezb
155     13/10/2019 12:01:15 am            RSM_HPC_NATIVEOPTIONS=
156     13/10/2019 12:01:15 am            ARC_ROOT=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts\..\..\ARC
157     13/10/2019 12:01:15 am            RSM_HPC_KEYWORD=ARC
158     13/10/2019 12:01:15 am            RSM_HPC_PARSE_MARKER=START
159     13/10/2019 12:01:15 am     -----------------------------------------------------------------------------
160     13/10/2019 12:01:16 am     ArcMaster process running as NT AUTHORITY\SYSTEM
161     13/10/2019 12:01:16 am     ArcNode process running as NT AUTHORITY\SYSTEM
162     13/10/2019 12:01:16 am     Skipping autostart because Master processes is started as a service.
163     13/10/2019 12:01:16 am             Name            Status     Priority   Start Time    End Time   Max Jobs      Allowed Machines         Allowed Users
164     13/10/2019 12:01:16 am     ================================================================================================================================
165     13/10/2019 12:01:16 am           default           Active        0        00:00:00     23:59:59      *     maincad:cluster01:clust...         all
166     13/10/2019 12:01:16 am            local            Active        0        00:00:00     23:59:59      *              maincad                   all
167     13/10/2019 12:01:16 am        * Indicates that resources have not been set up.  Any resource request will be accepted.
168     13/10/2019 12:01:16 am     External cluster command: checkQueueExists ---------------------------------------
169     13/10/2019 12:01:16 am        Cluster command before expansion: %RSM_PYTHON_EXE% -B -E "%RSM_HPC_SCRIPTS_DIRECTORY_LOCAL%/arcParsing.py" -queues %RSM_HPC_PARSE_MARKER%
170     13/10/2019 12:01:16 am        Final cluster command: C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python\python.exe -B -E "C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts/arcParsing.py" -queues START
171     13/10/2019 12:01:16 am        Working directory : \\MainCAD\RSMStaging\eubgp21n.ezb
172     13/10/2019 12:01:16 am        Variables:
173     13/10/2019 12:01:16 am            RSM_PYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python
174     13/10/2019 12:01:16 am            RSM_IRON_PYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython
175     13/10/2019 12:01:16 am            RSM_PYTHON_EXE=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python\python.exe
176     13/10/2019 12:01:16 am            RSM_TASK_WORKING_DIRECTORY=\\MainCAD\RSMStaging\eubgp21n.ezb
177     13/10/2019 12:01:16 am            RSM_USE_SSH_LINUX=False
178     13/10/2019 12:01:16 am            RSM_QUEUE_NAME=default
179     13/10/2019 12:01:16 am            RSM_CONFIGUREDQUEUE_NAME=Default
180     13/10/2019 12:01:16 am            RSM_COMPUTE_SERVER_MACHINE_NAME=Maincad
181     13/10/2019 12:01:16 am            RSM_HPC_JOBNAME=Mechanical
182     13/10/2019 12:01:16 am            RSM_HPC_DISPLAYNAME=Annulus_Thread_MAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)
183     13/10/2019 12:01:16 am            RSM_HPC_CORES=12
184     13/10/2019 12:01:16 am            RSM_HPC_DISTRIBUTED=TRUE
185     13/10/2019 12:01:16 am            RSM_HPC_NODE_EXCLUSIVE=FALSE
186     13/10/2019 12:01:16 am            RSM_HPC_QUEUE=default
187     13/10/2019 12:01:16 am            RSM_HPC_USER=MAINCAD\User
188     13/10/2019 12:01:16 am            RSM_HPC_WORKDIR=\\MainCAD\RSMStaging\eubgp21n.ezb
189     13/10/2019 12:01:16 am            RSM_HPC_JOBTYPE=Mechanical_ANSYS
190     13/10/2019 12:01:16 am            RSM_HPC_ANSYS_LOCAL_INSTALL_DIRECTORY=C:\Program Files\ANSYS Inc\v195
191     13/10/2019 12:01:16 am            RSM_HPC_VERSION=195
192     13/10/2019 12:01:16 am            RSM_HPC_STAGING=\\MainCAD\RSMStaging\eubgp21n.ezb
193     13/10/2019 12:01:16 am            RSM_HPC_LOCAL_PLATFORM=Windows
194     13/10/2019 12:01:16 am            RSM_HPC_CLUSTER_TARGET_PLATFORM=Windows
195     13/10/2019 12:01:16 am            RSM_HPC_STDOUTFILE=stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
196     13/10/2019 12:01:16 am            RSM_HPC_STDERRFILE=stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
197     13/10/2019 12:01:16 am            RSM_HPC_STDOUTLIVE=stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
198     13/10/2019 12:01:16 am            RSM_HPC_STDERRLIVE=stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
199     13/10/2019 12:01:16 am            RSM_HPC_SCRIPTS_DIRECTORY_LOCAL=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts
200     13/10/2019 12:01:16 am            RSM_HPC_SCRIPTS_DIRECTORY=%AWP_ROOT195%\RSM\Config\scripts
201     13/10/2019 12:01:16 am            RSM_HPC_SUBMITHOST=localhost
202     13/10/2019 12:01:16 am            RSM_HPC_STORAGEID=<JobId>    <id>2e240152-9c98-4c8b-b806-5ccbbda6db14</id>    <nativeId>Mechanical=LocalOS#localhost$\\MainCAD\RSMStaging\eubgp21n.ezb</nativeId>    <timestamp>Saturday, October 12, 2019 11:01:15.288 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>
203     13/10/2019 12:01:16 am            RSM_HPC_PLATFORMSTORAGEID=\\MainCAD\RSMStaging\eubgp21n.ezb
204     13/10/2019 12:01:16 am            RSM_HPC_NATIVEOPTIONS=
205     13/10/2019 12:01:16 am            ARC_ROOT=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts\..\..\ARC
206     13/10/2019 12:01:16 am            RSM_HPC_KEYWORD=ARC
207     13/10/2019 12:01:16 am            RSM_HPC_PARSE_MARKER=START
208     13/10/2019 12:01:16 am            RSM_HPC_PRIMARY_STDOUT=ArcMaster process running as NT AUTHORITY\SYSTEM
209     13/10/2019 12:01:16 am     ArcNode process running as NT AUTHORITY\SYSTEM
210     13/10/2019 12:01:16 am     Skipping autostart because Master processes is started as a service.
211     13/10/2019 12:01:16 am             Name            Status     Priority   Start Time    End Time   Max Jobs      Allowed Machines         Allowed Users
212     13/10/2019 12:01:16 am     ================================================================================================================================
213     13/10/2019 12:01:16 am           default           Active        0        00:00:00     23:59:59      *     maincad:cluster01:clust...         all
214     13/10/2019 12:01:16 am            local            Active        0        00:00:00     23:59:59      *              maincad                   all
215     13/10/2019 12:01:16 am        * Indicates that resources have not been set up.  Any resource request will be accepted.
216     13/10/2019 12:01:16 am            RSM_HPC_PRIMARY_STDERR=
217     13/10/2019 12:01:16 am     ----------------------------------------------------------------------------------
218     13/10/2019 12:01:17 am     Executing command: %AWP_ROOT195%\SEC\SolverExecutionController\runsec.bat   (Ansys Solver)
219     13/10/2019 12:01:17 am     --------------- commands.xml file: \\MainCAD\RSMStaging\eubgp21n.ezb\commands.xml ---------------
220     13/10/2019 12:01:17 am        <?xml version="1.0" encoding="UTF-8" standalone="no" ?>
221     13/10/2019 12:01:17 am        <jobCommands version="2" wait="True">
222     13/10/2019 12:01:17 am    
223     13/10/2019 12:01:17 am          <distributed>true</distributed>
224     13/10/2019 12:01:17 am    
225     13/10/2019 12:01:17 am          <cores>12</cores>
226     13/10/2019 12:01:17 am    
227     13/10/2019 12:01:17 am          <environment/>
228     13/10/2019 12:01:17 am    
229     13/10/2019 12:01:17 am          <command name="Ansys Solver">
230     13/10/2019 12:01:17 am            <application>
231     13/10/2019 12:01:17 am              <app platform="win32|winx64">%AWP_ROOT195%\SEC\SolverExecutionController\runsec.bat</app>
232     13/10/2019 12:01:17 am              <app platform="linia32|linx64">%AWP_ROOT195%/SEC/SolverExecutionController/runsec.sh</app>
233     13/10/2019 12:01:17 am            </application>
234     13/10/2019 12:01:17 am            <arguments/>
235     13/10/2019 12:01:17 am          </command>
236     13/10/2019 12:01:17 am    
237     13/10/2019 12:01:17 am        </jobCommands>
238     13/10/2019 12:01:17 am     --------------- commands.xml file END ---------------
239     13/10/2019 12:01:17 am     --------------- SecInput.txt file: \\MainCAD\RSMStaging\eubgp21n.ezb\SecInput.txt ---------------
240     13/10/2019 12:01:17 am        #begin
241     13/10/2019 12:01:17 am        Modifier
242     13/10/2019 12:01:17 am        SolverTag
243     13/10/2019 12:01:17 am        Ansys
244     13/10/2019 12:01:17 am        #end
245     13/10/2019 12:01:17 am    
246     13/10/2019 12:01:17 am        #begin
247     13/10/2019 12:01:17 am        Modifier
248     13/10/2019 12:01:17 am        OperationMode
249     13/10/2019 12:01:17 am        Normal
250     13/10/2019 12:01:17 am        #end
251     13/10/2019 12:01:17 am    
252     13/10/2019 12:01:17 am        #begin
253     13/10/2019 12:01:17 am        InputData
254     13/10/2019 12:01:17 am        ProductVersion
255     13/10/2019 12:01:17 am        195
256     13/10/2019 12:01:17 am        #end
257     13/10/2019 12:01:17 am    
258     13/10/2019 12:01:17 am        #begin
259     13/10/2019 12:01:17 am        Modifier
260     13/10/2019 12:01:17 am        EnableApplicationBootstrapping
261     13/10/2019 12:01:17 am        True
262     13/10/2019 12:01:17 am        #end
263     13/10/2019 12:01:17 am    
264     13/10/2019 12:01:17 am        #begin
265     13/10/2019 12:01:17 am        InputData
266     13/10/2019 12:01:17 am        SelectivePluginList
267     13/10/2019 12:01:17 am        #list
268     13/10/2019 12:01:17 am        plugins.ansys
269     13/10/2019 12:01:17 am        plugins.common
270     13/10/2019 12:01:17 am        plugins.ekm
271     13/10/2019 12:01:17 am        bootstrap.ansys
272     13/10/2019 12:01:17 am        bootstrap.rsm
273     13/10/2019 12:01:17 am        bootstrap.common
274     13/10/2019 12:01:17 am        bootstrap.ekm
275     13/10/2019 12:01:17 am        #end
276     13/10/2019 12:01:17 am    
277     13/10/2019 12:01:17 am        #begin
278     13/10/2019 12:01:17 am        Modifier
279     13/10/2019 12:01:17 am        EnableRsmBootstrapping
280     13/10/2019 12:01:17 am        True
281     13/10/2019 12:01:17 am        #end
282     13/10/2019 12:01:17 am    
283     13/10/2019 12:01:17 am        #begin
284     13/10/2019 12:01:17 am        InputData
285     13/10/2019 12:01:17 am        AnsysJobName
286     13/10/2019 12:01:17 am        file
287     13/10/2019 12:01:17 am        #end
288     13/10/2019 12:01:17 am    
289     13/10/2019 12:01:17 am        #begin
290     13/10/2019 12:01:17 am        InputData
291     13/10/2019 12:01:17 am        AnsysOutFileName
292     13/10/2019 12:01:17 am        solve.out
293     13/10/2019 12:01:17 am        #end
294     13/10/2019 12:01:17 am    
295     13/10/2019 12:01:17 am        #begin
296     13/10/2019 12:01:17 am        Modifier
297     13/10/2019 12:01:17 am        CaptureSolverStdout
298     13/10/2019 12:01:17 am        True
299     13/10/2019 12:01:17 am        #end
300     13/10/2019 12:01:17 am    
301     13/10/2019 12:01:17 am        #begin
302     13/10/2019 12:01:17 am        Modifier
303     13/10/2019 12:01:17 am        CaptureSolverStderr
304     13/10/2019 12:01:17 am        True
305     13/10/2019 12:01:17 am        #end
306     13/10/2019 12:01:17 am    
307     13/10/2019 12:01:17 am        #begin
308     13/10/2019 12:01:17 am        Modifier
309     13/10/2019 12:01:17 am        Distributed
310     13/10/2019 12:01:17 am        On
311     13/10/2019 12:01:17 am        #end
312     13/10/2019 12:01:17 am    
313     13/10/2019 12:01:17 am        #begin
314     13/10/2019 12:01:17 am        Modifier
315     13/10/2019 12:01:17 am        AnsysEnableSlaveNodeCopyBack
316     13/10/2019 12:01:17 am        True
317     13/10/2019 12:01:17 am        #end
318     13/10/2019 12:01:17 am    
319     13/10/2019 12:01:17 am        #begin
320     13/10/2019 12:01:17 am        InputData
321     13/10/2019 12:01:17 am        NumberOfProcesses
322     13/10/2019 12:01:17 am        12
323     13/10/2019 12:01:17 am        #end
324     13/10/2019 12:01:17 am    
325     13/10/2019 12:01:17 am        #begin
326     13/10/2019 12:01:17 am        InputData
327     13/10/2019 12:01:17 am        Arguments
328     13/10/2019 12:01:17 am         -b nolist -s noread -p ansys -mpi intelmpi -i remote.dat -o solve.out
329     13/10/2019 12:01:17 am        #end
330     13/10/2019 12:01:17 am    
331     13/10/2019 12:01:17 am     --------------- SecInput.txt file END ---------------
332     13/10/2019 12:01:17 am     External cluster command: submit ---------------------------------------
333     13/10/2019 12:01:17 am        Cluster command before expansion: %ARC_ROOT%\bin\ArcSubmit.exe -q "%RSM_HPC_QUEUE%" -a "%RSM_HPC_JOBNAME%" %RSM_HPC_NATIVEOPTIONS% -n %RSM_HPC_CORES% -w "%RSM_HPC_STAGING%" -o "%RSM_HPC_STAGING%/%RSM_HPC_STDOUTFILE%" -e "%RSM_HPC_STAGING%/%RSM_HPC_STDERRFILE%" "%RSM_HPC_COMMAND%"
334     13/10/2019 12:01:17 am        Final cluster command: C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts\..\..\ARC\bin\ArcSubmit.exe -q "default" -a "Mechanical"  -n 12 -w "\\MainCAD\RSMStaging\eubgp21n.ezb" -o "\\MainCAD\RSMStaging\eubgp21n.ezb/stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout" -e "\\MainCAD\RSMStaging\eubgp21n.ezb/stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout" "clusterjob_9f9da426-822a-4234-a55a-2a8fc2bef7c8.bat"
335     13/10/2019 12:01:17 am        Working directory : \\MainCAD\RSMStaging\eubgp21n.ezb
336     13/10/2019 12:01:17 am        Variables:
337     13/10/2019 12:01:17 am            RSM_PYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python
338     13/10/2019 12:01:17 am            RSM_IRON_PYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython
339     13/10/2019 12:01:17 am            RSM_PYTHON_EXE=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python\python.exe
340     13/10/2019 12:01:17 am            RSM_TASK_WORKING_DIRECTORY=\\MainCAD\RSMStaging\eubgp21n.ezb
341     13/10/2019 12:01:17 am            RSM_USE_SSH_LINUX=False
342     13/10/2019 12:01:17 am            RSM_QUEUE_NAME=default
343     13/10/2019 12:01:17 am            RSM_CONFIGUREDQUEUE_NAME=Default
344     13/10/2019 12:01:17 am            RSM_COMPUTE_SERVER_MACHINE_NAME=Maincad
345     13/10/2019 12:01:17 am            RSM_HPC_JOBNAME=Mechanical
346     13/10/2019 12:01:17 am            RSM_HPC_DISPLAYNAME=Annulus_Thread_MAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)
347     13/10/2019 12:01:17 am            RSM_HPC_CORES=12
348     13/10/2019 12:01:17 am            RSM_HPC_DISTRIBUTED=TRUE
349     13/10/2019 12:01:17 am            RSM_HPC_NODE_EXCLUSIVE=FALSE
350     13/10/2019 12:01:17 am            RSM_HPC_QUEUE=default
351     13/10/2019 12:01:17 am            RSM_HPC_USER=MAINCAD\User
352     13/10/2019 12:01:17 am            RSM_HPC_WORKDIR=\\MainCAD\RSMStaging\eubgp21n.ezb
353     13/10/2019 12:01:17 am            RSM_HPC_JOBTYPE=Mechanical_ANSYS
354     13/10/2019 12:01:17 am            RSM_HPC_ANSYS_LOCAL_INSTALL_DIRECTORY=C:\Program Files\ANSYS Inc\v195
355     13/10/2019 12:01:17 am            RSM_HPC_VERSION=195
356     13/10/2019 12:01:17 am            RSM_HPC_STAGING=\\MainCAD\RSMStaging\eubgp21n.ezb
357     13/10/2019 12:01:17 am            RSM_HPC_LOCAL_PLATFORM=Windows
358     13/10/2019 12:01:17 am            RSM_HPC_CLUSTER_TARGET_PLATFORM=Windows
359     13/10/2019 12:01:17 am            RSM_HPC_STDOUTFILE=stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
360     13/10/2019 12:01:17 am            RSM_HPC_STDERRFILE=stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
361     13/10/2019 12:01:17 am            RSM_HPC_STDOUTLIVE=stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
362     13/10/2019 12:01:17 am            RSM_HPC_STDERRLIVE=stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
363     13/10/2019 12:01:17 am            RSM_HPC_SCRIPTS_DIRECTORY_LOCAL=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts
364     13/10/2019 12:01:17 am            RSM_HPC_SCRIPTS_DIRECTORY=%AWP_ROOT195%\RSM\Config\scripts
365     13/10/2019 12:01:17 am            RSM_HPC_SUBMITHOST=localhost
366     13/10/2019 12:01:17 am            RSM_HPC_STORAGEID=<JobId>    <id>2e240152-9c98-4c8b-b806-5ccbbda6db14</id>    <nativeId>Mechanical=LocalOS#localhost$\\MainCAD\RSMStaging\eubgp21n.ezb</nativeId>    <timestamp>Saturday, October 12, 2019 11:01:15.288 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>
367     13/10/2019 12:01:17 am            RSM_HPC_PLATFORMSTORAGEID=\\MainCAD\RSMStaging\eubgp21n.ezb
368     13/10/2019 12:01:17 am            RSM_HPC_NATIVEOPTIONS=
369     13/10/2019 12:01:17 am            ARC_ROOT=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts\..\..\ARC
370     13/10/2019 12:01:17 am            RSM_HPC_KEYWORD=ARC
371     13/10/2019 12:01:17 am            RSM_HPC_COMMAND=clusterjob_9f9da426-822a-4234-a55a-2a8fc2bef7c8.bat
372     13/10/2019 12:01:17 am            RSM_HPC_PARSE_MARKER=START
373     13/10/2019 12:01:17 am     ------------------------------------------------------------------------
374     13/10/2019 12:01:17 am     ArcMaster process running as NT AUTHORITY\SYSTEM
375     13/10/2019 12:01:17 am     ArcNode process running as NT AUTHORITY\SYSTEM
376     13/10/2019 12:01:17 am     Skipping autostart because Master processes is started as a service.
377     13/10/2019 12:01:17 am     Job was successfully submitted as <9>
378     13/10/2019 12:01:17 am     External cluster command: parseSubmit ---------------------------------------
379     13/10/2019 12:01:17 am        Cluster command before expansion: %RSM_PYTHON_EXE% -B -E "%RSM_HPC_SCRIPTS_DIRECTORY_LOCAL%/arcParsing.py" -submit %RSM_HPC_PARSE_MARKER%
380     13/10/2019 12:01:17 am        Final cluster command: C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python\python.exe -B -E "C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts/arcParsing.py" -submit START
381     13/10/2019 12:01:17 am        Working directory : \\MainCAD\RSMStaging\eubgp21n.ezb
382     13/10/2019 12:01:17 am        Variables:
383     13/10/2019 12:01:17 am            RSM_PYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python
384     13/10/2019 12:01:17 am            RSM_IRON_PYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython
385     13/10/2019 12:01:17 am            RSM_PYTHON_EXE=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python\python.exe
386     13/10/2019 12:01:17 am            RSM_TASK_WORKING_DIRECTORY=\\MainCAD\RSMStaging\eubgp21n.ezb
387     13/10/2019 12:01:17 am            RSM_USE_SSH_LINUX=False
388     13/10/2019 12:01:17 am            RSM_QUEUE_NAME=default
389     13/10/2019 12:01:17 am            RSM_CONFIGUREDQUEUE_NAME=Default
390     13/10/2019 12:01:17 am            RSM_COMPUTE_SERVER_MACHINE_NAME=Maincad
391     13/10/2019 12:01:17 am            RSM_HPC_JOBNAME=Mechanical
392     13/10/2019 12:01:17 am            RSM_HPC_DISPLAYNAME=Annulus_Thread_MAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)
393     13/10/2019 12:01:17 am            RSM_HPC_CORES=12
394     13/10/2019 12:01:17 am            RSM_HPC_DISTRIBUTED=TRUE
395     13/10/2019 12:01:17 am            RSM_HPC_NODE_EXCLUSIVE=FALSE
396     13/10/2019 12:01:17 am            RSM_HPC_QUEUE=default
397     13/10/2019 12:01:17 am            RSM_HPC_USER=MAINCAD\User
398     13/10/2019 12:01:17 am            RSM_HPC_WORKDIR=\\MainCAD\RSMStaging\eubgp21n.ezb
399     13/10/2019 12:01:17 am            RSM_HPC_JOBTYPE=Mechanical_ANSYS
400     13/10/2019 12:01:17 am            RSM_HPC_ANSYS_LOCAL_INSTALL_DIRECTORY=C:\Program Files\ANSYS Inc\v195
401     13/10/2019 12:01:17 am            RSM_HPC_VERSION=195
402     13/10/2019 12:01:17 am            RSM_HPC_STAGING=\\MainCAD\RSMStaging\eubgp21n.ezb
403     13/10/2019 12:01:17 am            RSM_HPC_LOCAL_PLATFORM=Windows
404     13/10/2019 12:01:17 am            RSM_HPC_CLUSTER_TARGET_PLATFORM=Windows
405     13/10/2019 12:01:17 am            RSM_HPC_STDOUTFILE=stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
406     13/10/2019 12:01:17 am            RSM_HPC_STDERRFILE=stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
407     13/10/2019 12:01:17 am            RSM_HPC_STDOUTLIVE=stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
408     13/10/2019 12:01:17 am            RSM_HPC_STDERRLIVE=stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
409     13/10/2019 12:01:17 am            RSM_HPC_SCRIPTS_DIRECTORY_LOCAL=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts
410     13/10/2019 12:01:17 am            RSM_HPC_SCRIPTS_DIRECTORY=%AWP_ROOT195%\RSM\Config\scripts
411     13/10/2019 12:01:17 am            RSM_HPC_SUBMITHOST=localhost
412     13/10/2019 12:01:17 am            RSM_HPC_STORAGEID=<JobId>    <id>2e240152-9c98-4c8b-b806-5ccbbda6db14</id>    <nativeId>Mechanical=LocalOS#localhost$\\MainCAD\RSMStaging\eubgp21n.ezb</nativeId>    <timestamp>Saturday, October 12, 2019 11:01:15.288 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>
413     13/10/2019 12:01:17 am            RSM_HPC_PLATFORMSTORAGEID=\\MainCAD\RSMStaging\eubgp21n.ezb
414     13/10/2019 12:01:17 am            RSM_HPC_NATIVEOPTIONS=
415     13/10/2019 12:01:17 am            ARC_ROOT=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts\..\..\ARC
416     13/10/2019 12:01:17 am            RSM_HPC_KEYWORD=ARC
417     13/10/2019 12:01:17 am            RSM_HPC_COMMAND=clusterjob_9f9da426-822a-4234-a55a-2a8fc2bef7c8.bat
418     13/10/2019 12:01:17 am            RSM_HPC_PARSE_MARKER=START
419     13/10/2019 12:01:17 am            RSM_HPC_PRIMARY_STDOUT=ArcMaster process running as NT AUTHORITY\SYSTEM
420     13/10/2019 12:01:17 am     ArcNode process running as NT AUTHORITY\SYSTEM
421     13/10/2019 12:01:17 am     Skipping autostart because Master processes is started as a service.
422     13/10/2019 12:01:17 am     Job was successfully submitted as <9>
423     13/10/2019 12:01:17 am            RSM_HPC_PRIMARY_STDERR=
424     13/10/2019 12:01:17 am     -----------------------------------------------------------------------------
425     13/10/2019 12:01:17 am     JobId was parsed as: 9
426     13/10/2019 12:01:17 am     Job submission was successful.
427     13/10/2019 12:01:22 am     Job is running on hostname Maincad
428     13/10/2019 12:01:22 am     Job user from this host: User
429     13/10/2019 12:01:22 am     Starting directory: \\MainCAD\RSMStaging\eubgp21n.ezb
430     13/10/2019 12:01:22 am     Reading control file \\MainCAD\RSMStaging\eubgp21n.ezb\control_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsm ....
431     13/10/2019 12:01:22 am     Correct Cluster verified
432     13/10/2019 12:01:22 am     Cluster Type: ARC
433     13/10/2019 12:01:22 am     Underlying Cluster: ARC
434     13/10/2019 12:01:22 am        RSM_CLUSTER_TYPE = ARC
435     13/10/2019 12:01:22 am     Compute Server is running on MAINCAD
436     13/10/2019 12:01:22 am     Reading commands and arguments...
437     13/10/2019 12:01:22 am        Command 1: %AWP_ROOT195%\SEC\SolverExecutionController\runsec.bat, arguments: , redirectFile: None
438     13/10/2019 12:01:22 am     Running from shared staging directory ...
439     13/10/2019 12:01:22 am        RSM_USE_LOCAL_SCRATCH = False
440     13/10/2019 12:01:22 am        RSM_LOCAL_SCRATCH_DIRECTORY =
441     13/10/2019 12:01:22 am        RSM_LOCAL_SCRATCH_PARTIAL_UNC_PATH =
442     13/10/2019 12:01:22 am     Cluster Shared Directory: \\MainCAD\RSMStaging\eubgp21n.ezb
443     13/10/2019 12:01:22 am        RSM_SHARE_STAGING_DIRECTORY = \\MainCAD\RSMStaging\eubgp21n.ezb
444     13/10/2019 12:01:22 am     Job file clean up: True
445     13/10/2019 12:01:22 am     Use SSH on Linux cluster nodes: False
446     13/10/2019 12:01:22 am        RSM_USE_SSH_LINUX = False
447     13/10/2019 12:01:22 am     LivelogFile: NOLIVELOGFILE
448     13/10/2019 12:01:22 am     StdoutLiveLogFile: stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
449     13/10/2019 12:01:22 am     StderrLiveLogFile: stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
450     13/10/2019 12:01:22 am     Reading input files...
451     13/10/2019 12:01:22 am        *.dat
452     13/10/2019 12:01:22 am        file*.*
453     13/10/2019 12:01:22 am        *.mac
454     13/10/2019 12:01:22 am        thermal.build
455     13/10/2019 12:01:22 am        commands.xml
456     13/10/2019 12:01:22 am        SecInput.txt
457     13/10/2019 12:01:22 am     Reading cancel files...
458     13/10/2019 12:01:22 am        file.abt
459     13/10/2019 12:01:22 am        sec.interrupt
460     13/10/2019 12:01:22 am     Reading output files...
461     13/10/2019 12:01:22 am        *.xml
462     13/10/2019 12:01:22 am        *.NR*
463     13/10/2019 12:01:22 am        CAERepOutput.xml
464     13/10/2019 12:01:22 am        cyclic_map.json
465     13/10/2019 12:01:22 am        exit.topo
466     13/10/2019 12:01:22 am        file*.dsub
467     13/10/2019 12:01:22 am        file*.ldhi
468     13/10/2019 12:01:22 am        file*.png
469     13/10/2019 12:01:22 am        file*.r0*
470     13/10/2019 12:01:22 am        file*.r1*
471     13/10/2019 12:01:22 am        file*.r2*
472     13/10/2019 12:01:22 am        file*.r3*
473     13/10/2019 12:01:22 am        file*.r4*
474     13/10/2019 12:01:22 am        file*.r5*
475     13/10/2019 12:01:22 am        file*.r6*
476     13/10/2019 12:01:22 am        file*.r7*
477     13/10/2019 12:01:22 am        file*.r8*
478     13/10/2019 12:01:22 am        file*.r9*
479     13/10/2019 12:01:22 am        file*.rd*
480     13/10/2019 12:01:22 am        file*.rst
481     13/10/2019 12:01:22 am        file.BCS
482     13/10/2019 12:01:22 am        file.ce
483     13/10/2019 12:01:22 am        file.cm
484     13/10/2019 12:01:22 am        file.cnd
485     13/10/2019 12:01:22 am        file.cnm
486     13/10/2019 12:01:22 am        file.DSP
487     13/10/2019 12:01:22 am        file.err
488     13/10/2019 12:01:22 am        file.gst
489     13/10/2019 12:01:22 am        file.json
490     13/10/2019 12:01:22 am        file.nd*
491     13/10/2019 12:01:22 am        file.nlh
492     13/10/2019 12:01:22 am        file.nr*
493     13/10/2019 12:01:22 am        file.PCS
494     13/10/2019 12:01:22 am        file.rdb
495     13/10/2019 12:01:22 am        file.rfl
496     13/10/2019 12:01:22 am        file.spm
497     13/10/2019 12:01:22 am        file0.BCS
498     13/10/2019 12:01:22 am        file0.ce
499     13/10/2019 12:01:22 am        file0.cnd
500     13/10/2019 12:01:22 am        file0.err
501     13/10/2019 12:01:22 am        file0.gst
502     13/10/2019 12:01:22 am        file0.nd*
503     13/10/2019 12:01:22 am        file0.nlh
504     13/10/2019 12:01:22 am        file0.nr*
505     13/10/2019 12:01:22 am        file0.PCS
506     13/10/2019 12:01:22 am        frequencies_*.out
507     13/10/2019 12:01:22 am        input.x17
508     13/10/2019 12:01:22 am        intermediate*.topo
509     13/10/2019 12:01:22 am        Mode_mapping_*.txt
510     13/10/2019 12:01:22 am        NotSupportedElems.dat
511     13/10/2019 12:01:22 am        ObjectiveHistory.out
512     13/10/2019 12:01:22 am        post.out
513     13/10/2019 12:01:22 am        PostImage*.png
514     13/10/2019 12:01:22 am        record.txt
515     13/10/2019 12:01:22 am        solve*.out
516     13/10/2019 12:01:22 am        topo.err
517     13/10/2019 12:01:22 am        toput
518     13/10/2019 12:01:22 am        vars.topo
519     13/10/2019 12:01:22 am        SecDebugLog.txt
520     13/10/2019 12:01:22 am        secStart.log
521     13/10/2019 12:01:22 am        sec.validation.executed
522     13/10/2019 12:01:22 am        sec.envvarvalidation.executed
523     13/10/2019 12:01:22 am        sec.failure
524     13/10/2019 12:01:22 am        *.xml
525     13/10/2019 12:01:22 am        *.NR*
526     13/10/2019 12:01:22 am        CAERepOutput.xml
527     13/10/2019 12:01:22 am        cyclic_map.json
528     13/10/2019 12:01:22 am        exit.topo
529     13/10/2019 12:01:22 am        file*.dsub
530     13/10/2019 12:01:22 am        file*.ldhi
531     13/10/2019 12:01:22 am        file*.png
532     13/10/2019 12:01:22 am        file*.r0*
533     13/10/2019 12:01:22 am        file*.r1*
534     13/10/2019 12:01:22 am        file*.r2*
535     13/10/2019 12:01:22 am        file*.r3*
536     13/10/2019 12:01:22 am        file*.r4*
537     13/10/2019 12:01:22 am        file*.r5*
538     13/10/2019 12:01:22 am        file*.r6*
539     13/10/2019 12:01:22 am        file*.r7*
540     13/10/2019 12:01:22 am        file*.r8*
541     13/10/2019 12:01:22 am        file*.r9*
542     13/10/2019 12:01:22 am        file*.rd*
543     13/10/2019 12:01:22 am        file*.rst
544     13/10/2019 12:01:22 am        file.BCS
545     13/10/2019 12:01:22 am        file.ce
546     13/10/2019 12:01:22 am        file.cm
547     13/10/2019 12:01:22 am        file.cnd
548     13/10/2019 12:01:22 am        file.cnm
549     13/10/2019 12:01:22 am        file.DSP
550     13/10/2019 12:01:22 am        file.err
551     13/10/2019 12:01:22 am        file.gst
552     13/10/2019 12:01:22 am        file.json
553     13/10/2019 12:01:22 am        file.nd*
554     13/10/2019 12:01:22 am        file.nlh
555     13/10/2019 12:01:22 am        file.nr*
556     13/10/2019 12:01:22 am        file.PCS
557     13/10/2019 12:01:22 am        file.rdb
558     13/10/2019 12:01:22 am        file.rfl
559     13/10/2019 12:01:22 am        file.spm
560     13/10/2019 12:01:22 am        file0.BCS
561     13/10/2019 12:01:22 am        file0.ce
562     13/10/2019 12:01:22 am        file0.cnd
563     13/10/2019 12:01:22 am        file0.err
564     13/10/2019 12:01:22 am        file0.gst
565     13/10/2019 12:01:22 am        file0.nd*
566     13/10/2019 12:01:22 am        file0.nlh
567     13/10/2019 12:01:22 am        file0.nr*
568     13/10/2019 12:01:22 am        file0.PCS
569     13/10/2019 12:01:22 am        frequencies_*.out
570     13/10/2019 12:01:22 am        input.x17
571     13/10/2019 12:01:22 am        intermediate*.topo
572     13/10/2019 12:01:22 am        Mode_mapping_*.txt
573     13/10/2019 12:01:22 am        NotSupportedElems.dat
574     13/10/2019 12:01:22 am        ObjectiveHistory.out
575     13/10/2019 12:01:22 am        post.out
576     13/10/2019 12:01:22 am        PostImage*.png
577     13/10/2019 12:01:22 am        record.txt
578     13/10/2019 12:01:22 am        solve*.out
579     13/10/2019 12:01:22 am        topo.err
580     13/10/2019 12:01:22 am        toput
581     13/10/2019 12:01:22 am        vars.topo
582     13/10/2019 12:01:22 am        SecDebugLog.txt
583     13/10/2019 12:01:22 am        sec.solverexitcode
584     13/10/2019 12:01:22 am        secStart.log
585     13/10/2019 12:01:22 am        sec.failure
586     13/10/2019 12:01:22 am        sec.envvarvalidation.executed
587     13/10/2019 12:01:22 am     Reading exclude files...
588     13/10/2019 12:01:22 am        stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
589     13/10/2019 12:01:22 am        stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
590     13/10/2019 12:01:22 am        control_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsm
591     13/10/2019 12:01:22 am        hosts.dat
592     13/10/2019 12:01:22 am        exitcode_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
593     13/10/2019 12:01:22 am        exitcodeCommands_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
594     13/10/2019 12:01:22 am        stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
595     13/10/2019 12:01:22 am        stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
596     13/10/2019 12:01:22 am        ClusterJobCustomization.xml
597     13/10/2019 12:01:22 am        ClusterJobs.py
598     13/10/2019 12:01:22 am        clusterjob_9f9da426-822a-4234-a55a-2a8fc2bef7c8.sh
599     13/10/2019 12:01:22 am        clusterjob_9f9da426-822a-4234-a55a-2a8fc2bef7c8.bat
600     13/10/2019 12:01:22 am        inquire.request
601     13/10/2019 12:01:22 am        inquire.confirm
602     13/10/2019 12:01:22 am        request.upload.rsm
603     13/10/2019 12:01:22 am        request.download.rsm
604     13/10/2019 12:01:22 am        wait.download.rsm
605     13/10/2019 12:01:22 am        scratch.job.rsm
606     13/10/2019 12:01:22 am        volatile.job.rsm
607     13/10/2019 12:01:22 am        restart.xml
608     13/10/2019 12:01:22 am        cancel_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
609     13/10/2019 12:01:22 am        liveLogLastPositions_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsm
610     13/10/2019 12:01:22 am        stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8_kill.rsmout
611     13/10/2019 12:01:22 am        stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8_kill.rsmout
612     13/10/2019 12:01:22 am        sec.interrupt
613     13/10/2019 12:01:22 am        stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8_*.rsmout
614     13/10/2019 12:01:22 am        stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8_*.rsmout
615     13/10/2019 12:01:22 am        stdout_task_*.live
616     13/10/2019 12:01:22 am        stderr_task_*.live
617     13/10/2019 12:01:22 am        control_task_*.rsm
618     13/10/2019 12:01:22 am        stdout_task_*.rsmout
619     13/10/2019 12:01:22 am        stderr_task_*.rsmout
620     13/10/2019 12:01:22 am        exitcode_task_*.rsmout
621     13/10/2019 12:01:22 am        exitcodeCommands_task_*.rsmout
622     13/10/2019 12:01:22 am        file.abt
623     13/10/2019 12:01:22 am     Reading environment variables...
624     13/10/2019 12:01:22 am        RSM_IRON_PYTHON_HOME = C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython
625     13/10/2019 12:01:22 am        RSM_TASK_WORKING_DIRECTORY = \\MainCAD\RSMStaging\eubgp21n.ezb
626     13/10/2019 12:01:22 am        RSM_USE_SSH_LINUX = False
627     13/10/2019 12:01:22 am        RSM_QUEUE_NAME = default
628     13/10/2019 12:01:22 am        RSM_CONFIGUREDQUEUE_NAME = Default
629     13/10/2019 12:01:22 am        RSM_COMPUTE_SERVER_MACHINE_NAME = Maincad
630     13/10/2019 12:01:22 am        RSM_HPC_JOBNAME = Mechanical
631     13/10/2019 12:01:22 am        RSM_HPC_DISPLAYNAME = Annulus_Thread_MAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)
632     13/10/2019 12:01:22 am        RSM_HPC_CORES = 12
633     13/10/2019 12:01:22 am        RSM_HPC_DISTRIBUTED = TRUE
634     13/10/2019 12:01:22 am        RSM_HPC_NODE_EXCLUSIVE = FALSE
635     13/10/2019 12:01:22 am        RSM_HPC_QUEUE = default
636     13/10/2019 12:01:22 am        RSM_HPC_USER = MAINCAD\User
637     13/10/2019 12:01:22 am        RSM_HPC_WORKDIR = \\MainCAD\RSMStaging\eubgp21n.ezb
638     13/10/2019 12:01:22 am        RSM_HPC_JOBTYPE = Mechanical_ANSYS
639     13/10/2019 12:01:22 am        RSM_HPC_ANSYS_LOCAL_INSTALL_DIRECTORY = C:\Program Files\ANSYS Inc\v195
640     13/10/2019 12:01:22 am        RSM_HPC_VERSION = 195
641     13/10/2019 12:01:22 am        RSM_HPC_STAGING = \\MainCAD\RSMStaging\eubgp21n.ezb
642     13/10/2019 12:01:22 am        RSM_HPC_LOCAL_PLATFORM = Windows
643     13/10/2019 12:01:22 am        RSM_HPC_CLUSTER_TARGET_PLATFORM = Windows
644     13/10/2019 12:01:22 am        RSM_HPC_STDOUTFILE = stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
645     13/10/2019 12:01:22 am        RSM_HPC_STDERRFILE = stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
646     13/10/2019 12:01:22 am        RSM_HPC_STDOUTLIVE = stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
647     13/10/2019 12:01:22 am        RSM_HPC_STDERRLIVE = stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
648     13/10/2019 12:01:22 am        RSM_HPC_SCRIPTS_DIRECTORY_LOCAL = C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts
649     13/10/2019 12:01:22 am        RSM_HPC_SCRIPTS_DIRECTORY = C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts
650     13/10/2019 12:01:22 am        RSM_HPC_SUBMITHOST = localhost
651     13/10/2019 12:01:22 am        RSM_HPC_STORAGEID = <JobId>    <id>2e240152-9c98-4c8b-b806-5ccbbda6db14</id>    <nativeId>Mechanical=LocalOS#localhost$\\MainCAD\RSMStaging\eubgp21n.ezb</nativeId>    <timestamp>Saturday, October 12, 2019 11:01:15.288 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>
652     13/10/2019 12:01:22 am        RSM_HPC_PLATFORMSTORAGEID = \\MainCAD\RSMStaging\eubgp21n.ezb
653     13/10/2019 12:01:22 am        RSM_HPC_NATIVEOPTIONS =
654     13/10/2019 12:01:22 am        ARC_ROOT = C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts\..\..\ARC
655     13/10/2019 12:01:22 am        RSM_HPC_KEYWORD = ARC
656     13/10/2019 12:01:22 am        RSM_PYTHON_LOCALE = en-us
657     13/10/2019 12:01:22 am     Reading AWP_ROOT environment variable name ...
658     13/10/2019 12:01:22 am        AWP_ROOT environment variable name is: AWP_ROOT195
659     13/10/2019 12:01:22 am     Reading Low Disk Space Warning Limit ...
660     13/10/2019 12:01:22 am        Low disk space warning threshold set at: 2.0GiB
661     13/10/2019 12:01:22 am     Reading File identifier ...
662     13/10/2019 12:01:22 am        File identifier found as: 9f9da426-822a-4234-a55a-2a8fc2bef7c8
663     13/10/2019 12:01:22 am     Done reading control file.
664     13/10/2019 12:01:22 am     RSM_AWP_ROOT_NAME = AWP_ROOT195
665     13/10/2019 12:01:22 am     AWP_ROOT195 install directory: C:\Program Files\ANSYS Inc\v195
666     13/10/2019 12:01:22 am     RSM_MACHINES = maincad:4:cluster01:4:cluster02:4
667     13/10/2019 12:01:22 am     Number of nodes assigned for current job = 3
668     13/10/2019 12:01:22 am     Machine list: ['maincad', 'cluster01', 'cluster02']
669     13/10/2019 12:01:22 am     Checking DisableUNCCheck ...
670     13/10/2019 12:01:22 am     Unable to read registry for HKEY_CURRENT_USER\Software\Microsoft\Command Processor
671     13/10/2019 12:01:22 am     Ignore verifying DisableUNCCheck, you may check it manually if not already done so.
672     13/10/2019 12:01:22 am     Start running job commands ...
673     13/10/2019 12:01:22 am     Running on machine : Maincad
674     13/10/2019 12:01:22 am     Current Directory: \\MainCAD\RSMStaging\eubgp21n.ezb
675     13/10/2019 12:01:22 am     Running command: C:\Program Files\ANSYS Inc\v195\SEC\SolverExecutionController\runsec.bat
676     13/10/2019 12:01:22 am     Redirecting output to  None
677     13/10/2019 12:01:22 am     Final command arg list : ['C:\\Program Files\\ANSYS Inc\\v195\\SEC\\SolverExecutionController\\runsec.bat']
678     13/10/2019 12:01:22 am     Running Process
679     13/10/2019 12:01:22 am     Running Solver : C:\Program Files\ANSYS Inc\v195\ansys\bin\winx64\ANSYS195.exe -b nolist -s noread -p ansys -mpi intelmpi -i remote.dat -o solve.out -dis -machines maincad:4:cluster01:4:cluster02:4 -dir "//MainCAD/RSMStaging/eubgp21n.ezb"
680     13/10/2019 12:01:22 am     *** The AWP_ROOT195 environment variable is set to: C:\Program Files\ANSYS Inc\v195
681     13/10/2019 12:01:22 am     *** The AWP_LOCALE195 environment variable is set to: en-us
682     13/10/2019 12:01:22 am     *** The ANSYS195_DIR environment variable is set to: C:\Program Files\ANSYS Inc\v195\ANSYS
683     13/10/2019 12:01:22 am     *** The ANSYS_SYSDIR environment variable is set to: winx64
684     13/10/2019 12:01:22 am     *** The ANSYS_SYSDIR32 environment variable is set to: intel
685     13/10/2019 12:01:22 am     *** The CADOE_DOCDIR195 environment variable is set to: C:\Program Files\ANSYS Inc\v195\CommonFiles\help\en-us\solviewer
686     13/10/2019 12:01:22 am     *** The CADOE_LIBDIR195 environment variable is set to: C:\Program Files\ANSYS Inc\v195\CommonFiles\Language\en-us
687     13/10/2019 12:01:22 am     *** The LSTC_LICENSE environment variable is set to: ANSYS
688     13/10/2019 12:01:22 am     *** The P_SCHEMA environment variable is set to: C:\Program Files\ANSYS Inc\v195\AISOL\CADIntegration\Parasolid\PSchema
689     13/10/2019 12:01:22 am     *** The TEMP environment variable is set to: C:\Users\User\AppData\Local\Temp
690     13/10/2019 12:02:02 am     *** FATAL ***
691     13/10/2019 12:02:02 am     *** FATAL ***
692     13/10/2019 12:02:02 am      Invalid working directory value= //MainCAD/RSMStaging/eubgp21n.ezb
693     13/10/2019 12:02:02 am      (specified working directory does not exist)
694     13/10/2019 12:02:02 am     *** NOTE ***
695     13/10/2019 12:02:02 am      USAGE: C:\Program Files\ANSYS Inc\v195\ANSYS\bin\winx64\ANSYS.EXE
696     13/10/2019 12:02:02 am                         [-d device name] [-j job name]
697     13/10/2019 12:02:02 am                         [-b list|nolist] [-m scratch memory(mb)]
698     13/10/2019 12:02:02 am                         [-s read|noread] [-g] [-db database(mb)]
699     13/10/2019 12:02:02 am                         [-p product] [-l language]
700     13/10/2019 12:02:02 am      Invalid working directory value= //MainCAD/RSMStaging/eubgp21n.ezb
701     13/10/2019 12:02:02 am      (specified working directory does not exist)
702     13/10/2019 12:02:02 am     *** NOTE ***
703     13/10/2019 12:02:02 am      USAGE: C:\Program Files\ANSYS Inc\v195\ANSYS\bin\winx64\ANSYS.EXE
704     13/10/2019 12:02:02 am                         [-d device name] [-j job name]
705     13/10/2019 12:02:02 am                         [-b list|nolist] [-m scratch memory(mb)]
706     13/10/2019 12:02:02 am                         [-s read|noread] [-g] [-db database(mb)]
707     13/10/2019 12:02:02 am                         [-p product] [-l language]
708     13/10/2019 12:02:02 am                         [-dyn] [-np #] [-mfm]
709     13/10/2019 12:02:02 am                         [-dvt] [-dis] [-machines list]
710     13/10/2019 12:02:02 am                         [-i inputfile] [-o outputfile]
711     13/10/2019 12:02:02 am                         [-ser port] [-scport port]
712     13/10/2019 12:02:02 am                         [-scname couplingname] [-schost hostname]
713     13/10/2019 12:02:02 am                         [-smp] [-mpi intelmpi|ibmmpi|msmpi]
714     13/10/2019 12:02:02 am                         [-dir working_directory ]
715     13/10/2019 12:02:02 am                         [-acc nvidia] [-na #]
716     13/10/2019 12:02:02 am     *** FATAL ***
717     13/10/2019 12:02:02 am      Invalid working directory value= //MainCAD/RSMStaging/eubgp21n.ezb
718     13/10/2019 12:02:02 am      (specified working directory does not exist)
719     13/10/2019 12:02:02 am     *** NOTE ***
720     13/10/2019 12:02:02 am      USAGE: C:\Program Files\ANSYS Inc\v195\ANSYS\bin\winx64\ANSYS.EXE
721     13/10/2019 12:02:02 am                         [-d device name] [-j job name]
722     13/10/2019 12:02:02 am                         [-b list|nolist] [-m scratch memory(mb)]
723     13/10/2019 12:02:02 am                         [-s read|noread] [-g] [-db database(mb)]
724     13/10/2019 12:02:02 am                         [-p product] [-l language]
725     13/10/2019 12:02:02 am                         [-dyn] [-np #] [-mfm]
726     13/10/2019 12:02:02 am                         [-dvt] [-dis] [-machines list]
727     13/10/2019 12:02:02 am                         [-i inputfile] [-o outputfile]
728     13/10/2019 12:02:02 am                         [-ser port] [-scport port]
729     13/10/2019 12:02:02 am                         [-scname couplingname] [-schost hostname]
730     13/10/2019 12:02:02 am                         [-smp] [-mpi intelmpi|ibmmpi|msmpi]
731     13/10/2019 12:02:02 am                         [-dir working_directory ]
732     13/10/2019 12:02:02 am                         [-acc nvidia] [-na #]
733     13/10/2019 12:02:02 am                         [-dyn] [-np #] [-mfm]
734     13/10/2019 12:02:02 am                         [-dvt] [-dis] [-machines list]
735     13/10/2019 12:02:02 am                         [-i inputfile] [-o outputfile]
736     13/10/2019 12:02:02 am                         [-ser port] [-scport port]
737     13/10/2019 12:02:02 am                         [-scname couplingname] [-schost hostname]
738     13/10/2019 12:02:02 am                         [-smp] [-mpi intelmpi|ibmmpi|msmpi]
739     13/10/2019 12:02:02 am                         [-dir working_directory ]
740     13/10/2019 12:02:02 am                         [-acc nvidia] [-na #]
741     13/10/2019 12:02:02 am     *** FATAL ***
742     13/10/2019 12:02:02 am      Invalid working directory value= //MainCAD/RSMStaging/eubgp21n.ezb
743     13/10/2019 12:02:02 am      (specified working directory does not exist)
744     13/10/2019 12:02:02 am     *** NOTE ***
745     13/10/2019 12:02:02 am      USAGE: C:\Program Files\ANSYS Inc\v195\ANSYS\bin\winx64\ANSYS.EXE
746     13/10/2019 12:02:02 am                         [-d device name] [-j job name]
747     13/10/2019 12:02:02 am                         [-b list|nolist] [-m scratch memory(mb)]
748     13/10/2019 12:02:02 am                         [-s read|noread] [-g] [-db database(mb)]
749     13/10/2019 12:02:02 am     *** FATAL ***
750     13/10/2019 12:02:02 am      Invalid working directory value= //MainCAD/RSMStaging/eubgp21n.ezb
751     13/10/2019 12:02:02 am      (specified working directory does not exist)
752     13/10/2019 12:02:02 am     *** NOTE ***
753     13/10/2019 12:02:02 am      USAGE: C:\Program Files\ANSYS Inc\v195\ANSYS\bin\winx64\ANSYS.EXE
754     13/10/2019 12:02:02 am                         [-d device name] [-j job name]
755     13/10/2019 12:02:02 am                         [-b list|nolist] [-m scratch memory(mb)]
756     13/10/2019 12:02:02 am                         [-s read|noread] [-g] [-db database(mb)]
757     13/10/2019 12:02:02 am                         [-p product] [-l language]
758     13/10/2019 12:02:02 am                         [-dyn] [-np #] [-mfm]
759     13/10/2019 12:02:02 am                         [-dvt] [-dis] [-machines list]
760     13/10/2019 12:02:02 am                         [-i inputfile] [-o outputfile]
761     13/10/2019 12:02:02 am                         [-ser port] [-scport port]
762     13/10/2019 12:02:02 am                         [-scname couplingname] [-schost hostname]
763     13/10/2019 12:02:02 am                         [-smp] [-mpi intelmpi|ibmmpi|msmpi]
764     13/10/2019 12:02:02 am                         [-dir working_directory ]
765     13/10/2019 12:02:02 am                         [-acc nvidia] [-na #]
766     13/10/2019 12:02:02 am     *** FATAL ***
767     13/10/2019 12:02:02 am      Invalid working directory value= //MainCAD/RSMStaging/eubgp21n.ezb
768     13/10/2019 12:02:02 am      (specified working directory does not exist)
769     13/10/2019 12:02:02 am     *** NOTE ***
770     13/10/2019 12:02:02 am      USAGE: C:\Program Files\ANSYS Inc\v195\ANSYS\bin\winx64\ANSYS.EXE
771     13/10/2019 12:02:02 am                         [-d device name] [-j job name]
772     13/10/2019 12:02:02 am                         [-b list|nolist] [-m scratch memory(mb)]
773     13/10/2019 12:02:02 am                         [-s read|noread] [-g] [-db database(mb)]
774     13/10/2019 12:02:02 am                         [-p product] [-l language]
775     13/10/2019 12:02:02 am                         [-dyn] [-np #] [-mfm]
776     13/10/2019 12:02:02 am                         [-dvt] [-dis] [-machines list]
777     13/10/2019 12:02:02 am                         [-i inputfile] [-o outputfile]
778     13/10/2019 12:02:02 am                         [-ser port] [-scport port]
779     13/10/2019 12:02:02 am                         [-scname couplingname] [-schost hostname]
780     13/10/2019 12:02:02 am                         [-smp] [-mpi intelmpi|ibmmpi|msmpi]
781     13/10/2019 12:02:02 am                         [-dir working_directory ]
782     13/10/2019 12:02:02 am                         [-acc nvidia] [-na #]
783     13/10/2019 12:02:02 am                         [-p product] [-l language]
784     13/10/2019 12:02:02 am                         [-dyn] [-np #] [-mfm]
785     13/10/2019 12:02:02 am                         [-dvt] [-dis] [-machines list]
786     13/10/2019 12:02:02 am                         [-i inputfile] [-o outputfile]
787     13/10/2019 12:02:02 am                         [-ser port] [-scport port]
788     13/10/2019 12:02:02 am                         [-scname couplingname] [-schost hostname]
789     13/10/2019 12:02:02 am                         [-smp] [-mpi intelmpi|ibmmpi|msmpi]
790     13/10/2019 12:02:02 am                         [-dir working_directory ]
791     13/10/2019 12:02:02 am                         [-acc nvidia] [-na #]
792     13/10/2019 12:02:02 am     *** FATAL ***
793     13/10/2019 12:02:02 am      Invalid working directory value= //MainCAD/RSMStaging/eubgp21n.ezb
794     13/10/2019 12:02:02 am      (specified working directory does not exist)
795     13/10/2019 12:02:02 am     *** NOTE ***
796     13/10/2019 12:02:02 am      USAGE: C:\Program Files\ANSYS Inc\v195\ANSYS\bin\winx64\ANSYS.EXE
797     13/10/2019 12:02:02 am                         [-d device name] [-j job name]
798     13/10/2019 12:02:02 am                         [-b list|nolist] [-m scratch memory(mb)]
799     13/10/2019 12:02:02 am                         [-s read|noread] [-g] [-db database(mb)]
800     13/10/2019 12:02:02 am                         [-p product] [-l language]
801     13/10/2019 12:02:02 am                         [-dyn] [-np #] [-mfm]
802     13/10/2019 12:02:02 am                         [-dvt] [-dis] [-machines list]
803     13/10/2019 12:02:02 am                         [-i inputfile] [-o outputfile]
804     13/10/2019 12:02:02 am                         [-ser port] [-scport port]
805     13/10/2019 12:02:02 am                         [-scname couplingname] [-schost hostname]
806     13/10/2019 12:02:02 am                         [-smp] [-mpi intelmpi|ibmmpi|msmpi]
807     13/10/2019 12:02:02 am                         [-dir working_directory ]
808     13/10/2019 12:02:02 am                         [-acc nvidia] [-na #]
809     13/10/2019 12:02:04 am     *** FATAL ***
810     13/10/2019 12:02:04 am      Invalid working directory value= //MainCAD/RSMStaging/eubgp21n.ezb
811     13/10/2019 12:02:04 am      (specified working directory does not exist)
812     13/10/2019 12:02:04 am     *** NOTE ***
813     13/10/2019 12:02:04 am      USAGE: C:\Program Files\ANSYS Inc\v195\ANSYS\bin\winx64\ANSYS.EXE
814     13/10/2019 12:02:04 am                         [-d device name] [-j job name]
815     13/10/2019 12:02:04 am                         [-b list|nolist] [-m scratch memory(mb)]
816     13/10/2019 12:02:04 am                         [-s read|noread] [-g] [-db database(mb)]
817     13/10/2019 12:02:04 am                         [-p product] [-l language]
818     13/10/2019 12:02:04 am                         [-dyn] [-np #] [-mfm]
819     13/10/2019 12:02:04 am                         [-dvt] [-dis] [-machines list]
820     13/10/2019 12:02:04 am                         [-i inputfile] [-o outputfile]
821     13/10/2019 12:02:04 am                         [-ser port] [-scport port]
822     13/10/2019 12:02:04 am                         [-scname couplingname] [-schost hostname]
823     13/10/2019 12:02:04 am                         [-smp] [-mpi intelmpi|ibmmpi|msmpi]
824     13/10/2019 12:02:04 am                         [-dir working_directory ]
825     13/10/2019 12:02:04 am                         [-acc nvidia] [-na #]
826     13/10/2019 12:04:03 am     send of 20 bytes failed.
827     13/10/2019 12:04:03 am     application called MPI_Abort(MPI_COMM_WORLD, 99) - process 0
828     13/10/2019 12:04:03 am     [mpiexec@Maincad] ..\hydra\utils\sock\sock.c (420): write error (Unknown error)
829     13/10/2019 12:04:03 am     [mpiexec@Maincad] ..\hydra\utils\launch\launch.c (121): shutdown failed, sock 580, error 10093
830     13/10/2019 12:04:04 am     External cluster command: queryStatus ---------------------------------------
831     13/10/2019 12:04:04 am        Cluster command before expansion: %ARC_ROOT%\bin\ArcStatus.exe %RSM_HPC_JOBID%
832     13/10/2019 12:04:04 am        Final cluster command: C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts\..\..\ARC\bin\ArcStatus.exe 9
833     13/10/2019 12:04:04 am        Working directory : \\MainCAD\RSMStaging\eubgp21n.ezb
834     13/10/2019 12:04:04 am        Variables:
835     13/10/2019 12:04:04 am            RSM_PYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python
836     13/10/2019 12:04:04 am            RSM_IRON_PYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython
837     13/10/2019 12:04:04 am            RSM_PYTHON_EXE=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python\python.exe
838     13/10/2019 12:04:04 am            RSM_TASK_WORKING_DIRECTORY=\\MainCAD\RSMStaging\eubgp21n.ezb
839     13/10/2019 12:04:04 am            RSM_USE_SSH_LINUX=False
840     13/10/2019 12:04:04 am            RSM_QUEUE_NAME=default
841     13/10/2019 12:04:04 am            RSM_CONFIGUREDQUEUE_NAME=Default
842     13/10/2019 12:04:04 am            RSM_COMPUTE_SERVER_MACHINE_NAME=Maincad
843     13/10/2019 12:04:04 am            RSM_HPC_JOBNAME=Mechanical
844     13/10/2019 12:04:04 am            RSM_HPC_DISPLAYNAME=Annulus_Thread_MAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)
845     13/10/2019 12:04:04 am            RSM_HPC_DIRECTORY_SHARED=FALSE
846     13/10/2019 12:04:04 am            RSM_HPC_USER=MAINCAD\User
847     13/10/2019 12:04:04 am            RSM_HPC_WORKDIR=\\MainCAD\RSMStaging\eubgp21n.ezb
848     13/10/2019 12:04:04 am            RSM_HPC_JOBTYPE=Mechanical_ANSYS
849     13/10/2019 12:04:04 am            RSM_HPC_ANSYS_LOCAL_INSTALL_DIRECTORY=C:\Program Files\ANSYS Inc\v195
850     13/10/2019 12:04:04 am            RSM_HPC_VERSION=195
851     13/10/2019 12:04:04 am            RSM_HPC_STAGING=\\MainCAD\RSMStaging\eubgp21n.ezb
852     13/10/2019 12:04:04 am            RSM_HPC_LOCAL_PLATFORM=Windows
853     13/10/2019 12:04:04 am            RSM_HPC_CLUSTER_TARGET_PLATFORM=Windows
854     13/10/2019 12:04:04 am            RSM_HPC_STDOUTFILE=stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
855     13/10/2019 12:04:04 am            RSM_HPC_STDERRFILE=stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
856     13/10/2019 12:04:04 am            RSM_HPC_STDOUTLIVE=stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
857     13/10/2019 12:04:04 am            RSM_HPC_STDERRLIVE=stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
858     13/10/2019 12:04:04 am            RSM_HPC_SCRIPTS_DIRECTORY_LOCAL=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts
859     13/10/2019 12:04:04 am            RSM_HPC_SCRIPTS_DIRECTORY=%AWP_ROOT195%\RSM\Config\scripts
860     13/10/2019 12:04:04 am            RSM_HPC_SUBMITHOST=localhost
861     13/10/2019 12:04:04 am            RSM_HPC_STORAGEID=<JobId>    <id>2e240152-9c98-4c8b-b806-5ccbbda6db14</id>    <nativeId>Mechanical=LocalOS#localhost$\\MainCAD\RSMStaging\eubgp21n.ezb</nativeId>    <timestamp>Saturday, October 12, 2019 11:01:15.288 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>
862     13/10/2019 12:04:04 am            RSM_HPC_PLATFORMSTORAGEID=\\MainCAD\RSMStaging\eubgp21n.ezb
863     13/10/2019 12:04:04 am            RSM_HPC_NATIVEOPTIONS=
864     13/10/2019 12:04:04 am            ARC_ROOT=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts\..\..\ARC
865     13/10/2019 12:04:04 am            RSM_HPC_KEYWORD=ARC
866     13/10/2019 12:04:04 am            RSM_HPC_JOBID=9
867     13/10/2019 12:04:04 am            RSM_HPC_PARSE_MARKER=START
868     13/10/2019 12:04:04 am     -----------------------------------------------------------------------------
869     13/10/2019 12:04:04 am     Status of Job <9> is <Failed>
870     13/10/2019 12:04:04 am     ----------------------------
871     13/10/2019 12:04:04 am     JobNumber           9
872     13/10/2019 12:04:04 am     Status              Failed
873     13/10/2019 12:04:04 am     UserName            MAINCAD\User
874     13/10/2019 12:04:04 am     Cores               12
875     13/10/2019 12:04:04 am     Submit Time         10/13/2019 00:01:17
876     13/10/2019 12:04:04 am     Queue               default
877     13/10/2019 12:04:04 am     Assigned Machines   maincad:4:cluster01:4:cluster02:4
878     13/10/2019 12:04:04 am     Info                Error: Exitcode: 99
879     13/10/2019 12:04:04 am     Error files were empty or were in a protected location. Check output file for misdirected errors.
880     13/10/2019 12:04:04 am     Last 15 lines of Output File:
881     13/10/2019 12:04:04 am     Job started on MAINCAD
882     13/10/2019 12:04:04 am     ClusterSharedDirectory=\\MainCAD\RSMStaging\eubgp21n.ezb
883     13/10/2019 12:04:04 am     AWP_ROOT195=C:\Program Files\ANSYS Inc\v195
884     13/10/2019 12:04:04 am     Command=C:\Program Files\ANSYS Inc\v195/commonfiles/CPython/2_7_15/winx64/Release/python/python.exe
885     13/10/2019 12:04:04 am     running the commmand
886     13/10/2019 12:04:04 am     command: "C:\Program Files\ANSYS Inc\v195/commonfiles/CPython/2_7_15/winx64/Release/python/python.exe" -B -E "C:\Program Files\ANSYS Inc\v195/RSM/Config/scripts/ClusterJobs.py" "\\MainCAD\RSMStaging\eubgp21n.ezb\control_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsm"
887     13/10/2019 12:04:04 am     External cluster command: parseStatus ---------------------------------------
888     13/10/2019 12:04:04 am        Cluster command before expansion: %RSM_PYTHON_EXE% -B -E "%RSM_HPC_SCRIPTS_DIRECTORY_LOCAL%/arcParsing.py" -status %RSM_HPC_PARSE_MARKER%
889     13/10/2019 12:04:04 am        Final cluster command: C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python\python.exe -B -E "C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts/arcParsing.py" -status START
890     13/10/2019 12:04:04 am        Working directory : \\MainCAD\RSMStaging\eubgp21n.ezb
891     13/10/2019 12:04:04 am        Variables:
892     13/10/2019 12:04:04 am            RSM_PYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python
893     13/10/2019 12:04:04 am            RSM_IRON_PYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython
894     13/10/2019 12:04:04 am            RSM_PYTHON_EXE=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python\python.exe
895     13/10/2019 12:04:04 am            RSM_TASK_WORKING_DIRECTORY=\\MainCAD\RSMStaging\eubgp21n.ezb
896     13/10/2019 12:04:04 am            RSM_USE_SSH_LINUX=False
897     13/10/2019 12:04:04 am            RSM_QUEUE_NAME=default
898     13/10/2019 12:04:04 am            RSM_CONFIGUREDQUEUE_NAME=Default
899     13/10/2019 12:04:04 am            RSM_COMPUTE_SERVER_MACHINE_NAME=Maincad
900     13/10/2019 12:04:04 am            RSM_HPC_JOBNAME=Mechanical
901     13/10/2019 12:04:04 am            RSM_HPC_DISPLAYNAME=Annulus_Thread_MAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)
902     13/10/2019 12:04:04 am            RSM_HPC_DIRECTORY_SHARED=FALSE
903     13/10/2019 12:04:04 am            RSM_HPC_USER=MAINCAD\User
904     13/10/2019 12:04:04 am            RSM_HPC_WORKDIR=\\MainCAD\RSMStaging\eubgp21n.ezb
905     13/10/2019 12:04:04 am            RSM_HPC_JOBTYPE=Mechanical_ANSYS
906     13/10/2019 12:04:04 am            RSM_HPC_ANSYS_LOCAL_INSTALL_DIRECTORY=C:\Program Files\ANSYS Inc\v195
907     13/10/2019 12:04:04 am            RSM_HPC_VERSION=195
908     13/10/2019 12:04:04 am            RSM_HPC_STAGING=\\MainCAD\RSMStaging\eubgp21n.ezb
909     13/10/2019 12:04:04 am            RSM_HPC_LOCAL_PLATFORM=Windows
910     13/10/2019 12:04:04 am            RSM_HPC_CLUSTER_TARGET_PLATFORM=Windows
911     13/10/2019 12:04:04 am            RSM_HPC_STDOUTFILE=stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
912     13/10/2019 12:04:04 am            RSM_HPC_STDERRFILE=stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
913     13/10/2019 12:04:04 am            RSM_HPC_STDOUTLIVE=stdout_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
914     13/10/2019 12:04:04 am            RSM_HPC_STDERRLIVE=stderr_9f9da426-822a-4234-a55a-2a8fc2bef7c8.live
915     13/10/2019 12:04:04 am            RSM_HPC_SCRIPTS_DIRECTORY_LOCAL=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts
916     13/10/2019 12:04:04 am            RSM_HPC_SCRIPTS_DIRECTORY=%AWP_ROOT195%\RSM\Config\scripts
917     13/10/2019 12:04:04 am            RSM_HPC_SUBMITHOST=localhost
918     13/10/2019 12:04:04 am            RSM_HPC_STORAGEID=<JobId>    <id>2e240152-9c98-4c8b-b806-5ccbbda6db14</id>    <nativeId>Mechanical=LocalOS#localhost$\\MainCAD\RSMStaging\eubgp21n.ezb</nativeId>    <timestamp>Saturday, October 12, 2019 11:01:15.288 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>
919     13/10/2019 12:04:04 am            RSM_HPC_PLATFORMSTORAGEID=\\MainCAD\RSMStaging\eubgp21n.ezb
920     13/10/2019 12:04:04 am            RSM_HPC_NATIVEOPTIONS=
921     13/10/2019 12:04:04 am            ARC_ROOT=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts\..\..\ARC
922     13/10/2019 12:04:04 am            RSM_HPC_KEYWORD=ARC
923     13/10/2019 12:04:04 am            RSM_HPC_JOBID=9
924     13/10/2019 12:04:04 am            RSM_HPC_PARSE_MARKER=START
925     13/10/2019 12:04:04 am            RSM_HPC_PRIMARY_STDOUT=Status of Job <9> is <Failed>
926     13/10/2019 12:04:04 am     ----------------------------
927     13/10/2019 12:04:04 am     JobNumber           9
928     13/10/2019 12:04:04 am     Status              Failed
929     13/10/2019 12:04:04 am     UserName            MAINCAD\User
930     13/10/2019 12:04:04 am     Cores               12
931     13/10/2019 12:04:04 am     Submit Time         10/13/2019 00:01:17
932     13/10/2019 12:04:04 am     Queue               default
933     13/10/2019 12:04:04 am     Assigned Machines   maincad:4:cluster01:4:cluster02:4
934     13/10/2019 12:04:04 am     Info                Error: Exitcode: 99
935     13/10/2019 12:04:04 am     Error files were empty or were in a protected location. Check output file for misdirected errors.
936     13/10/2019 12:04:04 am     Last 15 lines of Output File:
937     13/10/2019 12:04:04 am     Job started on MAINCAD
938     13/10/2019 12:04:04 am     ClusterSharedDirectory=\\MainCAD\RSMStaging\eubgp21n.ezb
939     13/10/2019 12:04:04 am     AWP_ROOT195=C:\Program Files\ANSYS Inc\v195
940     13/10/2019 12:04:04 am     Command=C:\Program Files\ANSYS Inc\v195/commonfiles/CPython/2_7_15/winx64/Release/python/python.exe
941     13/10/2019 12:04:04 am     running the commmand
942     13/10/2019 12:04:04 am     command: "C:\Program Files\ANSYS Inc\v195/commonfiles/CPython/2_7_15/winx64/Release/python/python.exe" -B -E "C:\Program Files\ANSYS Inc\v195/RSM/Config/scripts/ClusterJobs.py" "\\MainCAD\RSMStaging\eubgp21n.ezb\control_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsm"
943     13/10/2019 12:04:04 am            RSM_HPC_PRIMARY_STDERR=
944     13/10/2019 12:04:04 am     -----------------------------------------------------------------------------
945     13/10/2019 12:04:04 am     ClusterJobs Command Exit Code: 99
946     13/10/2019 12:04:04 am     Command Exit Code: 99
947     13/10/2019 12:04:04 am     Saving exit code file: \\MainCAD\RSMStaging\eubgp21n.ezb\exitcode_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
948     13/10/2019 12:04:04 am        Exit code file: \\MainCAD\RSMStaging\eubgp21n.ezb\exitcode_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout has been created.
949     13/10/2019 12:04:04 am     Saving exit code file: \\MainCAD\RSMStaging\eubgp21n.ezb\exitcodeCommands_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout
950     13/10/2019 12:04:04 am        Exit code file: \\MainCAD\RSMStaging\eubgp21n.ezb\exitcodeCommands_9f9da426-822a-4234-a55a-2a8fc2bef7c8.rsmout has been created.
951     13/10/2019 12:04:04 am     =======SOLVE.OUT FILE======
952     13/10/2019 12:04:04 am     solve -->  *** FATAL ***
953     13/10/2019 12:04:04 am     solve --> Attempt to run ANSYS in a distributed mode failed.
954     13/10/2019 12:04:04 am     solve -->   The Distributed ANSYS process with MPI Rank ID =    4 is not responding.
955     13/10/2019 12:04:04 am     solve -->   Please refer to the Distributed ANSYS Guide for detailed setup and configuration information.
956     13/10/2019 12:04:04 am     ClusterJobs Exiting with code: 99
957     13/10/2019 12:04:04 am     Individual Command Exit Codes are: [99]
958     13/10/2019 12:04:07 am     Status query received, but job status is terminal. No need to query cluster.
959     13/10/2019 12:04:08 am     Status query received, but job status is terminal. No need to query cluster.
960     13/10/2019 12:19:40 am     Status query received, but job status is terminal. No need to query cluster.
961     13/10/2019 12:21:16 am     Status query received, but job status is terminal. No need to query cluster.

jcallery posted this 11 October 2019

For this log it appears as though running CMD from a UNC path is blocked.

To unblock it please do the following on each machine:

Start a registry editor (e.g., regedit.exe).

Navigate to theHKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Command Processor registry subkey.

From the Edit menu, select New, DWORD Value; enter the name DisableUNCCheck; then press Enter.

Double-click the new value, set it to 1, then click OK.

Close the registry editor.

Reboot the machine

Thank you,

Jake

kolyan007 posted this 11 October 2019

The localhost HPC Resource has been changed to use operating system file transfer to the cluster staging directory, as on the screenshot above, to use UNC folder: \\maincad\RSMStaging.

 

Solve process has failed with the error message below:

1 11/10/2019 1:580 pm RSM Version: 19.5.420.0, Build Date: 30/07/2019 57:06 am

2 11/10/2019 1:580 pm RSM File Version: 19.5.0-beta.3+Branch.release-19.5.Sha.9c15e0a3e0a608e8efe8c568e494d2160788d025

3 11/10/2019 1:580 pm RSM Library Version: 19.5.0.0

4 11/10/2019 1:580 pm Job Name: AnnulusThreadMAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)

5 11/10/2019 1:580 pm    Type: Mechanical_ANSYS

6 11/10/2019 1:580 pm    Client Directory: C:\TestProject - Copy - Copy_ProjectScratch\Scr771B\

7 11/10/2019 1:580 pm    Client Machine: Maincad

8 11/10/2019 1:580 pm    Queue: Default [localhost, default]

9 11/10/2019 1:580 pm    Template: Mechanical_ANSYSJob.xml

10 11/10/2019 1:580 pm Cluster Configuration: localhost [localhost]

11 11/10/2019 1:580 pm    Cluster Type: ARC

12 11/10/2019 1:580 pm    Custom Keyword: blank

13 11/10/2019 1:580 pm    Transfer Option: NativeOS

14 11/10/2019 1:580 pm    Staging Directory: \MainCAD\RSMStaging

15 11/10/2019 1:580 pm    Delete Staging Directory: True

16 11/10/2019 1:580 pm    Local Scratch Directory: blank

17 11/10/2019 1:580 pm    Platform: Windows

18 11/10/2019 1:580 pm    Cluster Submit Options: blank

19 11/10/2019 1:580 pm    Normal Inputs: [.dat,file.,.mac,thermal.build,commands.xml,SecInput.txt]

20 11/10/2019 1:580 pm    Cancel Inputs: [file.abt,sec.interrupt]

21 11/10/2019 1:580 pm    Excluded Inputs: [-]

22 11/10/2019 1:580 pm    Normal Outputs: [.xml,.NR,CAERepOutput.xml,cyclic_map.json,exit.topo,file.dsub,file.ldhi,file.png,file.r0,file.r1,file.r2,file.r3,file.r4,file.r5,file.r6,file.r7,file.r8,file.r9,file.rd,file.rst,file.BCS,file.ce,file.cm,file.cnd,file.cnm,file.DSP,file.err,file.gst,file.json,file.nd,file.nlh,file.nr,file.PCS,file.rdb,file.rfl,file.spm,file0.BCS,file0.ce,file0.cnd,file0.err,file0.gst,file0.nd,file0.nlh,file0.nr,file0.PCS,frequencies_.out,input.x17,intermediate.topo,Mode_mapping_.txt,NotSupportedElems.dat,ObjectiveHistory.out,post.out,PostImage.png,record.txt,solve.out,topo.err,toput,vars.topo,SecDebugLog.txt,secStart.log,sec.validation.executed,sec.envvarvalidation.executed,sec.failure]

23 11/10/2019 1:580 pm    Failure Outputs: [.xml,.NR,CAERepOutput.xml,cyclic_map.json,exit.topo,file.dsub,file.ldhi,file.png,file.r0,file.r1,file.r2,file.r3,file.r4,file.r5,file.r6,file.r7,file.r8,file.r9,file.rd,file.rst,file.BCS,file.ce,file.cm,file.cnd,file.cnm,file.DSP,file.err,file.gst,file.json,file.nd,file.nlh,file.nr,file.PCS,file.rdb,file.rfl,file.spm,file0.BCS,file0.ce,file0.cnd,file0.err,file0.gst,file0.nd,file0.nlh,file0.nr,file0.PCS,frequencies_.out,input.x17,intermediate.topo,Mode_mapping_.txt,NotSupportedElems.dat,ObjectiveHistory.out,post.out,PostImage.png,record.txt,solve.out,topo.err,toput,vars.topo,SecDebugLog.txt,sec.solverexitcode,secStart.log,sec.failure,sec.envvarvalidation.executed]

24 11/10/2019 1:580 pm    Cancel Outputs: [file*.err,solve.out,secStart.log,SecDebugLog.txt]

25 11/10/2019 1:580 pm    Excluded Outputs: [-]

26 11/10/2019 1:580 pm    Inquire Files:

27 11/10/2019 1:580 pm      normal: [.xml,.NR,CAERepOutput.xml,cyclic_map.json,exit.topo,file.dsub,file.ldhi,file.png,file.r0,file.r1,file.r2,file.r3,file.r4,file.r5,file.r6,file.r7,file.r8,file.r9,file.rd,file.rst,file.BCS,file.ce,file.cm,file.cnd,file.cnm,file.DSP,file.err,file.gst,file.json,file.nd,file.nlh,file.nr,file.PCS,file.rdb,file.rfl,file.spm,file0.BCS,file0.ce,file0.cnd,file0.err,file0.gst,file0.nd,file0.nlh,file0.nr,file0.PCS,frequencies_.out,input.x17,intermediate.topo,Mode_mapping_.txt,NotSupportedElems.dat,ObjectiveHistory.out,post.out,PostImage.png,record.txt,solve.out,topo.err,toput,vars.topo,SecDebugLog.txt,secStart.log,sec.validation.executed,sec.envvarvalidation.executed,sec.failure]

28 11/10/2019 1:580 pm      cancel: [file*.err,solve.out,secStart.log,SecDebugLog.txt]

29 11/10/2019 1:580 pm      failure: [.xml,.NR,CAERepOutput.xml,cyclic_map.json,exit.topo,file.dsub,file.ldhi,file.png,file.r0,file.r1,file.r2,file.r3,file.r4,file.r5,file.r6,file.r7,file.r8,file.r9,file.rd,file.rst,file.BCS,file.ce,file.cm,file.cnd,file.cnm,file.DSP,file.err,file.gst,file.json,file.nd,file.nlh,file.nr,file.PCS,file.rdb,file.rfl,file.spm,file0.BCS,file0.ce,file0.cnd,file0.err,file0.gst,file0.nd,file0.nlh,file0.nr,file0.PCS,frequencies_.out,input.x17,intermediate.topo,Mode_mapping_.txt,NotSupportedElems.dat,ObjectiveHistory.out,post.out,PostImage.png,record.txt,solve.out,topo.err,toput,vars.topo,SecDebugLog.txt,sec.solverexitcode,secStart.log,sec.failure,sec.envvarvalidation.executed]

30 11/10/2019 1:580 pm      RemotePostInformation: [RemotePostInformation.txt]

31 11/10/2019 1:580 pm      SolutionInformation: [solve.out,file.gst,file.nlh,file0.gst,file0.nlh,file.cnd]

32 11/10/2019 1:580 pm      PostDuringSolve: [file.rcn,file.redm,file.rfl,file.rfrq,file.rmg,file.rdsp,file.rsx,file.rst,file.rth,solve.out,file.gst,file.nlh,file0.gst,file0.nlh,file.cnd]

33 11/10/2019 1:580 pm      transcript: [solve.out,monitor.json]

34 11/10/2019 1:580 pm Submission in progress...

35 11/10/2019 1:580 pm Created storage directory \MainCAD\RSMStaging\4w4eooau.l0x

36 11/10/2019 1:580 pm Runtime Settings:

37 11/10/2019 1:580 pm    Job Owner: MAINCAD\User

38 11/10/2019 1:580 pm    Submit Time: Friday, 11 October 2019 1:58 pm

39 11/10/2019 1:580 pm    Directory: \MainCAD\RSMStaging\4w4eooau.l0x

40 11/10/2019 1:580 pm File Transfer Package: Upload to localhost:0

41 11/10/2019 1:580 pm    Name: RSMUploadDuring_Submit

42 11/10/2019 1:580 pm    Local Directory: C:\TestProject - Copy - Copy_ProjectScratch\Scr771B\

43 11/10/2019 1:580 pm    Storage Path: \MainCAD\RSMStaging\4w4eooau.l0x

44 11/10/2019 1:580 pm    Storage Location:

45 11/10/2019 1:580 pm    Files: [.dat,file.,.mac,thermal.build,commands.xml,SecInput.txt]

46 11/10/2019 1:580 pm    Exclude: [-]

47 11/10/2019 1:580 pm Storage contents:

48 11/10/2019 1:580 pm Uploading file: C:\TestProject - Copy - Copy_ProjectScratch\Scr771B\ds.dat

49 11/10/2019 1:580 pm Copying C:\TestProject - Copy - Copy_ProjectScratch\Scr771B\ds.dat to //MainCAD/RSMStaging/4w4eooau.l0x/ds.dat

50 11/10/2019 1:580 pm        File size: 39897206 bytes,  transferred: 39897206 bytes.

51 11/10/2019 1:580 pm Uploading file: C:\TestProject - Copy - Copy_ProjectScratch\Scr771B\remote.dat

52 11/10/2019 1:580 pm Copying C:\TestProject - Copy - Copy_ProjectScratch\Scr771B\remote.dat to //MainCAD/RSMStaging/4w4eooau.l0x/remote.dat

53 11/10/2019 1:580 pm        File size: 179 bytes,  transferred: 179 bytes.

54 11/10/2019 1:580 pm Uploading file: C:\TestProject - Copy - Copy_ProjectScratch\Scr771B\commands.xml

55 11/10/2019 1:580 pm Copying C:\TestProject - Copy - Copy_ProjectScratch\Scr771B\commands.xml to //MainCAD/RSMStaging/4w4eooau.l0x/commands.xml

56 11/10/2019 1:580 pm        File size: 477 bytes,  transferred: 477 bytes.

57 11/10/2019 1:580 pm Uploading file: C:\TestProject - Copy - Copy_ProjectScratch\Scr771B\SecInput.txt

58 11/10/2019 1:580 pm Copying C:\TestProject - Copy - Copy_ProjectScratch\Scr771B\SecInput.txt to //MainCAD/RSMStaging/4w4eooau.l0x/SecInput.txt

59 11/10/2019 1:580 pm        File size: 899 bytes,  transferred: 899 bytes.

60 11/10/2019 1:580 pm Storage contents:

61 11/10/2019 1:580 pm    ds.dat

62 11/10/2019 1:580 pm    remote.dat

63 11/10/2019 1:580 pm    commands.xml

64 11/10/2019 1:580 pm    SecInput.txt

65 11/10/2019 1:580 pm 39898.76 KB, .11 sec (364982.55 KB/sec)

66 11/10/2019 1:580 pm Submission in progress...

67 11/10/2019 1:580 pm Commands from commands.xml file

68 11/10/2019 1:580 pm Behavior code: Ansys.Rsm.ClusterOperations.Behaviors.MechanicalAnsysBehaviors

69 11/10/2019 1:580 pm Loading Cluster Customization file C:\Program Files\ANSYS Inc\v195\RSM\Config\xml\ClusterJobCustomization.xml.

70 11/10/2019 1:580 pm No customization found for cluster machineName Maincad, type ARC

71 11/10/2019 1:580 pm HPC Commands Files Used:

72 11/10/2019 1:580 pm    hpccommandsARC.xml

73 11/10/2019 1:580 pm Environment variables:

74 11/10/2019 1:580 pm    RSMPYTHONHOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python

75 11/10/2019 1:580 pm    RSMIRONPYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython

76 11/10/2019 1:580 pm    RSMPYTHONEXE=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python\python.exe

77 11/10/2019 1:580 pm    RSMTASKWORKING_DIRECTORY=\MainCAD\RSMStaging\4w4eooau.l0x

78 11/10/2019 1:580 pm    RSMUSESSH_LINUX=False

79 11/10/2019 1:580 pm    RSMQUEUENAME=default

80 11/10/2019 1:580 pm    RSMCONFIGUREDQUEUENAME=Default

81 11/10/2019 1:580 pm    RSMCOMPUTESERVERMACHINENAME=Maincad

82 11/10/2019 1:580 pm    RSMHPCJOBNAME=Mechanical

83 11/10/2019 1:580 pm    RSMHPCDISPLAYNAME=AnnulusThreadMAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)

84 11/10/2019 1:580 pm    RSMHPCCORES=12

85 11/10/2019 1:580 pm    RSMHPCDISTRIBUTED=TRUE

86 11/10/2019 1:580 pm    RSMHPCNODE_EXCLUSIVE=FALSE

87 11/10/2019 1:580 pm    RSMHPCQUEUE=default

88 11/10/2019 1:580 pm    RSMHPCUSER=MAINCAD\User

89 11/10/2019 1:580 pm    RSMHPCWORKDIR=\MainCAD\RSMStaging\4w4eooau.l0x

90 11/10/2019 1:580 pm    RSMHPCJOBTYPE=Mechanical_ANSYS

91 11/10/2019 1:580 pm    RSMHPCANSYSLOCALINSTALL_DIRECTORY=C:\Program Files\ANSYS Inc\v195

92 11/10/2019 1:580 pm    RSMHPCVERSION=195

93 11/10/2019 1:580 pm    RSMHPCSTAGING=\MainCAD\RSMStaging\4w4eooau.l0x

94 11/10/2019 1:580 pm    RSMHPCLOCAL_PLATFORM=Windows

95 11/10/2019 1:580 pm    RSMHPCCLUSTERTARGETPLATFORM=Windows

96 11/10/2019 1:580 pm    RSMHPCSTDOUTFILE=stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

97 11/10/2019 1:580 pm    RSMHPCSTDERRFILE=stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

98 11/10/2019 1:580 pm    RSMHPCSTDOUTLIVE=stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.live

99 11/10/2019 1:580 pm    RSMHPCSTDERRLIVE=stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.live

100 11/10/2019 1:580 pm    RSMHPCSCRIPTSDIRECTORYLOCAL=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts

101 11/10/2019 1:580 pm    RSMHPCSCRIPTSDIRECTORY=%AWPROOT195%\RSM\Config\scripts

102 11/10/2019 1:580 pm    RSMHPCSUBMITHOST=localhost

103 11/10/2019 1:580 pm    RSMHPCSTORAGEID=<JobId>    <id>dc1790b9-6290-4019-9b18-38acc7465469</id>    <nativeId>Mechanical=LocalOS#localhost$\MainCAD\RSMStaging\4w4eooau.l0x</nativeId>    <timestamp>Friday, October 11, 2019 12:580.393 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>

104 11/10/2019 1:580 pm    RSMHPCPLATFORMSTORAGEID=\MainCAD\RSMStaging\4w4eooau.l0x

105 11/10/2019 1:580 pm    RSMHPCNATIVEOPTIONS=

106 11/10/2019 1:580 pm    ARC_ROOT=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts....\ARC

107 11/10/2019 1:580 pm    RSMHPCKEYWORD=ARC

108 11/10/2019 1:580 pm JobType is: Mechanical_ANSYS

109 11/10/2019 1:580 pm Final command platform: Windows

110 11/10/2019 1:580 pm RSMPYTHONHOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python

111 11/10/2019 1:580 pm RSMHPCJOBNAME=Mechanical

112 11/10/2019 1:580 pm Distributed mode requested: True

113 11/10/2019 1:580 pm RSMHPCDISTRIBUTED=TRUE

114 11/10/2019 1:580 pm Running 1 commands

115 11/10/2019 1:580 pm Job working directory: \MainCAD\RSMStaging\4w4eooau.l0x

116 11/10/2019 1:580 pm Number of CPU requested: 12

117 11/10/2019 1:580 pm AWP_ROOT195=C:\Program Files\ANSYS Inc\v195

118 11/10/2019 1:580 pm Checking queue default exists ...

119 11/10/2019 1:580 pm External cluster command: queryQueues ---------------------------------------

120 11/10/2019 1:580 pm    Cluster command before expansion: %ARC_ROOT%\bin\ArcQueues.exe

121 11/10/2019 1:580 pm    Final cluster command: C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts....\ARC\bin\ArcQueues.exe

122 11/10/2019 1:580 pm    Working directory : \MainCAD\RSMStaging\4w4eooau.l0x

123 11/10/2019 1:580 pm    Variables:

124 11/10/2019 1:580 pm        RSMPYTHONHOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python

125 11/10/2019 1:580 pm        RSMIRONPYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython

126 11/10/2019 1:580 pm        RSMPYTHONEXE=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python\python.exe

127 11/10/2019 1:580 pm        RSMTASKWORKING_DIRECTORY=\MainCAD\RSMStaging\4w4eooau.l0x

128 11/10/2019 1:580 pm        RSMUSESSH_LINUX=False

129 11/10/2019 1:580 pm        RSMQUEUENAME=default

130 11/10/2019 1:580 pm        RSMCONFIGUREDQUEUENAME=Default

131 11/10/2019 1:580 pm        RSMCOMPUTESERVERMACHINENAME=Maincad

132 11/10/2019 1:580 pm        RSMHPCJOBNAME=Mechanical

133 11/10/2019 1:580 pm        RSMHPCDISPLAYNAME=AnnulusThreadMAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)

134 11/10/2019 1:580 pm        RSMHPCCORES=12

135 11/10/2019 1:580 pm        RSMHPCDISTRIBUTED=TRUE

136 11/10/2019 1:580 pm        RSMHPCNODE_EXCLUSIVE=FALSE

137 11/10/2019 1:580 pm        RSMHPCQUEUE=default

138 11/10/2019 1:580 pm        RSMHPCUSER=MAINCAD\User

139 11/10/2019 1:580 pm        RSMHPCWORKDIR=\MainCAD\RSMStaging\4w4eooau.l0x

140 11/10/2019 1:580 pm        RSMHPCJOBTYPE=Mechanical_ANSYS

141 11/10/2019 1:580 pm        RSMHPCANSYSLOCALINSTALL_DIRECTORY=C:\Program Files\ANSYS Inc\v195

142 11/10/2019 1:580 pm        RSMHPCVERSION=195

143 11/10/2019 1:580 pm        RSMHPCSTAGING=\MainCAD\RSMStaging\4w4eooau.l0x

144 11/10/2019 1:580 pm        RSMHPCLOCAL_PLATFORM=Windows

145 11/10/2019 1:580 pm        RSMHPCCLUSTERTARGETPLATFORM=Windows

146 11/10/2019 1:580 pm        RSMHPCSTDOUTFILE=stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

147 11/10/2019 1:580 pm        RSMHPCSTDERRFILE=stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

148 11/10/2019 1:580 pm        RSMHPCSTDOUTLIVE=stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.live

149 11/10/2019 1:580 pm        RSMHPCSTDERRLIVE=stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.live

150 11/10/2019 1:580 pm        RSMHPCSCRIPTSDIRECTORYLOCAL=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts

151 11/10/2019 1:580 pm        RSMHPCSCRIPTSDIRECTORY=%AWPROOT195%\RSM\Config\scripts

152 11/10/2019 1:580 pm        RSMHPCSUBMITHOST=localhost

153 11/10/2019 1:580 pm        RSMHPCSTORAGEID=<JobId>    <id>dc1790b9-6290-4019-9b18-38acc7465469</id>    <nativeId>Mechanical=LocalOS#localhost$\MainCAD\RSMStaging\4w4eooau.l0x</nativeId>    <timestamp>Friday, October 11, 2019 12:580.393 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>

154 11/10/2019 1:580 pm        RSMHPCPLATFORMSTORAGEID=\MainCAD\RSMStaging\4w4eooau.l0x

155 11/10/2019 1:580 pm        RSMHPCNATIVEOPTIONS=

156 11/10/2019 1:580 pm        ARC_ROOT=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts....\ARC

157 11/10/2019 1:580 pm        RSMHPCKEYWORD=ARC

158 11/10/2019 1:580 pm        RSMHPCPARSE_MARKER=START

159 11/10/2019 1:580 pm -----------------------------------------------------------------------------

160 11/10/2019 1:581 pm ArcMaster process running as NT AUTHORITY\SYSTEM

161 11/10/2019 1:581 pm ArcNode process running as NT AUTHORITY\SYSTEM

162 11/10/2019 1:581 pm Skipping autostart because Master processes is started as a service.

163 11/10/2019 1:581 pm         Name            Status     Priority   Start Time    End Time   Max Jobs      Allowed Machines         Allowed Users

164 11/10/2019 1:581 pm ================================================================================================================================

165 11/10/2019 1:581 pm       default           Active        0        00:00:00     23:59:59      *     maincad:cluster01:clust...         all

166 11/10/2019 1:581 pm        local            Active        0        00:00:00     23:59:59      *              maincad                   all

167 11/10/2019 1:581 pm    * Indicates that resources have not been set up.  Any resource request will be accepted.

168 11/10/2019 1:581 pm External cluster command: checkQueueExists ---------------------------------------

169 11/10/2019 1:581 pm    Cluster command before expansion: %RSMPYTHONEXE% -B -E "%RSMHPCSCRIPTSDIRECTORYLOCAL%/arcParsing.py" -queues %RSMHPCPARSE_MARKER%

170 11/10/2019 1:581 pm    Final cluster command: C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python\python.exe -B -E "C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts/arcParsing.py" -queues START

171 11/10/2019 1:581 pm    Working directory : \MainCAD\RSMStaging\4w4eooau.l0x

172 11/10/2019 1:581 pm    Variables:

173 11/10/2019 1:581 pm        RSMPYTHONHOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python

174 11/10/2019 1:581 pm        RSMIRONPYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython

175 11/10/2019 1:581 pm        RSMPYTHONEXE=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python\python.exe

176 11/10/2019 1:581 pm        RSMTASKWORKING_DIRECTORY=\MainCAD\RSMStaging\4w4eooau.l0x

177 11/10/2019 1:581 pm        RSMUSESSH_LINUX=False

178 11/10/2019 1:581 pm        RSMQUEUENAME=default

179 11/10/2019 1:581 pm        RSMCONFIGUREDQUEUENAME=Default

180 11/10/2019 1:581 pm        RSMCOMPUTESERVERMACHINENAME=Maincad

181 11/10/2019 1:581 pm        RSMHPCJOBNAME=Mechanical

182 11/10/2019 1:581 pm        RSMHPCDISPLAYNAME=AnnulusThreadMAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)

183 11/10/2019 1:581 pm        RSMHPCCORES=12

184 11/10/2019 1:581 pm        RSMHPCDISTRIBUTED=TRUE

185 11/10/2019 1:581 pm        RSMHPCNODE_EXCLUSIVE=FALSE

186 11/10/2019 1:581 pm        RSMHPCQUEUE=default

187 11/10/2019 1:581 pm        RSMHPCUSER=MAINCAD\User

188 11/10/2019 1:581 pm        RSMHPCWORKDIR=\MainCAD\RSMStaging\4w4eooau.l0x

189 11/10/2019 1:581 pm        RSMHPCJOBTYPE=Mechanical_ANSYS

190 11/10/2019 1:581 pm        RSMHPCANSYSLOCALINSTALL_DIRECTORY=C:\Program Files\ANSYS Inc\v195

191 11/10/2019 1:581 pm        RSMHPCVERSION=195

192 11/10/2019 1:581 pm        RSMHPCSTAGING=\MainCAD\RSMStaging\4w4eooau.l0x

193 11/10/2019 1:581 pm        RSMHPCLOCAL_PLATFORM=Windows

194 11/10/2019 1:581 pm        RSMHPCCLUSTERTARGETPLATFORM=Windows

195 11/10/2019 1:581 pm        RSMHPCSTDOUTFILE=stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

196 11/10/2019 1:581 pm        RSMHPCSTDERRFILE=stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

197 11/10/2019 1:581 pm        RSMHPCSTDOUTLIVE=stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.live

198 11/10/2019 1:581 pm        RSMHPCSTDERRLIVE=stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.live

199 11/10/2019 1:581 pm        RSMHPCSCRIPTSDIRECTORYLOCAL=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts

200 11/10/2019 1:581 pm        RSMHPCSCRIPTSDIRECTORY=%AWPROOT195%\RSM\Config\scripts

201 11/10/2019 1:581 pm        RSMHPCSUBMITHOST=localhost

202 11/10/2019 1:581 pm        RSMHPCSTORAGEID=<JobId>    <id>dc1790b9-6290-4019-9b18-38acc7465469</id>    <nativeId>Mechanical=LocalOS#localhost$\MainCAD\RSMStaging\4w4eooau.l0x</nativeId>    <timestamp>Friday, October 11, 2019 12:580.393 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>

203 11/10/2019 1:581 pm        RSMHPCPLATFORMSTORAGEID=\MainCAD\RSMStaging\4w4eooau.l0x

204 11/10/2019 1:581 pm        RSMHPCNATIVEOPTIONS=

205 11/10/2019 1:581 pm        ARC_ROOT=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts....\ARC

206 11/10/2019 1:581 pm        RSMHPCKEYWORD=ARC

207 11/10/2019 1:581 pm        RSMHPCPARSE_MARKER=START

208 11/10/2019 1:581 pm        RSMHPCPRIMARY_STDOUT=ArcMaster process running as NT AUTHORITY\SYSTEM

209 11/10/2019 1:581 pm ArcNode process running as NT AUTHORITY\SYSTEM

210 11/10/2019 1:581 pm Skipping autostart because Master processes is started as a service.

211 11/10/2019 1:581 pm         Name            Status     Priority   Start Time    End Time   Max Jobs      Allowed Machines         Allowed Users

212 11/10/2019 1:581 pm ================================================================================================================================

213 11/10/2019 1:581 pm       default           Active        0        00:00:00     23:59:59      *     maincad:cluster01:clust...         all

214 11/10/2019 1:581 pm        local            Active        0        00:00:00     23:59:59      *              maincad                   all

215 11/10/2019 1:581 pm    * Indicates that resources have not been set up.  Any resource request will be accepted.

216 11/10/2019 1:581 pm        RSMHPCPRIMARY_STDERR=

217 11/10/2019 1:581 pm ----------------------------------------------------------------------------------

218 11/10/2019 1:581 pm Executing command: %AWP_ROOT195%\SEC\SolverExecutionController\runsec.bat   (Ansys Solver)

219 11/10/2019 1:581 pm --------------- commands.xml file: \MainCAD\RSMStaging\4w4eooau.l0x\commands.xml ---------------

220 11/10/2019 1:581 pm    <?xml version="1.0" encoding="UTF-8" standalone="no" ?>

221 11/10/2019 1:581 pm    <jobCommands version="2" wait="True">

222 11/10/2019 1:581 pm  

223 11/10/2019 1:581 pm      <distributed>true</distributed>

224 11/10/2019 1:581 pm  

225 11/10/2019 1:581 pm      <cores>12</cores>

226 11/10/2019 1:581 pm  

227 11/10/2019 1:581 pm      <environment/>

228 11/10/2019 1:581 pm  

229 11/10/2019 1:581 pm      <command name="Ansys Solver">

230 11/10/2019 1:581 pm        <application>

231 11/10/2019 1:581 pm          <app platform="win32|winx64">%AWP_ROOT195%\SEC\SolverExecutionController\runsec.bat</app>

232 11/10/2019 1:581 pm          <app platform="linia32|linx64">%AWP_ROOT195%/SEC/SolverExecutionController/runsec.sh</app>

233 11/10/2019 1:581 pm        </application>

234 11/10/2019 1:581 pm        <arguments/>

235 11/10/2019 1:581 pm      </command>

236 11/10/2019 1:581 pm  

237 11/10/2019 1:581 pm    </jobCommands>

238 11/10/2019 1:581 pm --------------- commands.xml file END ---------------

239 11/10/2019 1:581 pm --------------- SecInput.txt file: \MainCAD\RSMStaging\4w4eooau.l0x\SecInput.txt ---------------

240 11/10/2019 1:581 pm    #begin

241 11/10/2019 1:581 pm    Modifier

242 11/10/2019 1:581 pm    SolverTag

243 11/10/2019 1:581 pm    Ansys

244 11/10/2019 1:581 pm    #end

245 11/10/2019 1:581 pm  

246 11/10/2019 1:581 pm    #begin

247 11/10/2019 1:581 pm    Modifier

248 11/10/2019 1:581 pm    OperationMode

249 11/10/2019 1:581 pm    Normal

250 11/10/2019 1:581 pm    #end

251 11/10/2019 1:581 pm  

252 11/10/2019 1:581 pm    #begin

253 11/10/2019 1:581 pm    InputData

254 11/10/2019 1:581 pm    ProductVersion

255 11/10/2019 1:581 pm    195

256 11/10/2019 1:581 pm    #end

257 11/10/2019 1:581 pm  

258 11/10/2019 1:581 pm    #begin

259 11/10/2019 1:581 pm    Modifier

260 11/10/2019 1:581 pm    EnableApplicationBootstrapping

261 11/10/2019 1:581 pm    True

262 11/10/2019 1:581 pm    #end

263 11/10/2019 1:581 pm  

264 11/10/2019 1:581 pm    #begin

265 11/10/2019 1:581 pm    InputData

266 11/10/2019 1:581 pm    SelectivePluginList

267 11/10/2019 1:581 pm    #list

268 11/10/2019 1:581 pm    plugins.ansys

269 11/10/2019 1:581 pm    plugins.common

270 11/10/2019 1:581 pm    plugins.ekm

271 11/10/2019 1:581 pm    bootstrap.ansys

272 11/10/2019 1:581 pm    bootstrap.rsm

273 11/10/2019 1:581 pm    bootstrap.common

274 11/10/2019 1:581 pm    bootstrap.ekm

275 11/10/2019 1:581 pm    #end

276 11/10/2019 1:581 pm  

277 11/10/2019 1:581 pm    #begin

278 11/10/2019 1:581 pm    Modifier

279 11/10/2019 1:581 pm    EnableRsmBootstrapping

280 11/10/2019 1:581 pm    True

281 11/10/2019 1:581 pm    #end

282 11/10/2019 1:581 pm  

283 11/10/2019 1:581 pm    #begin

284 11/10/2019 1:581 pm    InputData

285 11/10/2019 1:581 pm    AnsysJobName

286 11/10/2019 1:581 pm    file

287 11/10/2019 1:581 pm    #end

288 11/10/2019 1:581 pm  

289 11/10/2019 1:581 pm    #begin

290 11/10/2019 1:581 pm    InputData

291 11/10/2019 1:581 pm    AnsysOutFileName

292 11/10/2019 1:581 pm    solve.out

293 11/10/2019 1:581 pm    #end

294 11/10/2019 1:581 pm  

295 11/10/2019 1:581 pm    #begin

296 11/10/2019 1:581 pm    Modifier

297 11/10/2019 1:581 pm    CaptureSolverStdout

298 11/10/2019 1:581 pm    True

299 11/10/2019 1:581 pm    #end

300 11/10/2019 1:581 pm  

301 11/10/2019 1:581 pm    #begin

302 11/10/2019 1:581 pm    Modifier

303 11/10/2019 1:581 pm    CaptureSolverStderr

304 11/10/2019 1:581 pm    True

305 11/10/2019 1:581 pm    #end

306 11/10/2019 1:581 pm  

307 11/10/2019 1:581 pm    #begin

308 11/10/2019 1:581 pm    Modifier

309 11/10/2019 1:581 pm    Distributed

310 11/10/2019 1:581 pm    On

311 11/10/2019 1:581 pm    #end

312 11/10/2019 1:581 pm  

313 11/10/2019 1:581 pm    #begin

314 11/10/2019 1:581 pm    Modifier

315 11/10/2019 1:581 pm    AnsysEnableSlaveNodeCopyBack

316 11/10/2019 1:581 pm    True

317 11/10/2019 1:581 pm    #end

318 11/10/2019 1:581 pm  

319 11/10/2019 1:581 pm    #begin

320 11/10/2019 1:581 pm    InputData

321 11/10/2019 1:581 pm    NumberOfProcesses

322 11/10/2019 1:581 pm    12

323 11/10/2019 1:581 pm    #end

324 11/10/2019 1:581 pm  

325 11/10/2019 1:581 pm    #begin

326 11/10/2019 1:581 pm    InputData

327 11/10/2019 1:581 pm    Arguments

328 11/10/2019 1:581 pm     -b nolist -s noread -p ansys -mpi intelmpi -i remote.dat -o solve.out

329 11/10/2019 1:581 pm    #end

330 11/10/2019 1:581 pm  

331 11/10/2019 1:581 pm --------------- SecInput.txt file END ---------------

332 11/10/2019 1:581 pm External cluster command: submit ---------------------------------------

333 11/10/2019 1:581 pm    Cluster command before expansion: %ARCROOT%\bin\ArcSubmit.exe -q "%RSMHPCQUEUE%" -a "%RSMHPCJOBNAME%" %RSMHPCNATIVEOPTIONS% -n %RSMHPCCORES% -w "%RSMHPCSTAGING%" -o "%RSMHPCSTAGING%/%RSMHPCSTDOUTFILE%" -e "%RSMHPCSTAGING%/%RSMHPCSTDERRFILE%" "%RSMHPC_COMMAND%"

334 11/10/2019 1:581 pm    Final cluster command: C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts....\ARC\bin\ArcSubmit.exe -q "default" -a "Mechanical"  -n 12 -w "\MainCAD\RSMStaging\4w4eooau.l0x" -o "\MainCAD\RSMStaging\4w4eooau.l0x/stdout3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout" -e "\MainCAD\RSMStaging\4w4eooau.l0x/stderr3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout" "clusterjob_3a6b4620-8d29-4665-88a3-df770a04d30d.bat"

335 11/10/2019 1:581 pm    Working directory : \MainCAD\RSMStaging\4w4eooau.l0x

336 11/10/2019 1:581 pm    Variables:

337 11/10/2019 1:581 pm        RSMPYTHONHOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python

338 11/10/2019 1:581 pm        RSMIRONPYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython

339 11/10/2019 1:581 pm        RSMPYTHONEXE=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python\python.exe

340 11/10/2019 1:581 pm        RSMTASKWORKING_DIRECTORY=\MainCAD\RSMStaging\4w4eooau.l0x

341 11/10/2019 1:581 pm        RSMUSESSH_LINUX=False

342 11/10/2019 1:581 pm        RSMQUEUENAME=default

343 11/10/2019 1:581 pm        RSMCONFIGUREDQUEUENAME=Default

344 11/10/2019 1:581 pm        RSMCOMPUTESERVERMACHINENAME=Maincad

345 11/10/2019 1:581 pm        RSMHPCJOBNAME=Mechanical

346 11/10/2019 1:581 pm        RSMHPCDISPLAYNAME=AnnulusThreadMAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)

347 11/10/2019 1:581 pm        RSMHPCCORES=12

348 11/10/2019 1:581 pm        RSMHPCDISTRIBUTED=TRUE

349 11/10/2019 1:581 pm        RSMHPCNODE_EXCLUSIVE=FALSE

350 11/10/2019 1:581 pm        RSMHPCQUEUE=default

351 11/10/2019 1:581 pm        RSMHPCUSER=MAINCAD\User

352 11/10/2019 1:581 pm        RSMHPCWORKDIR=\MainCAD\RSMStaging\4w4eooau.l0x

353 11/10/2019 1:581 pm        RSMHPCJOBTYPE=Mechanical_ANSYS

354 11/10/2019 1:581 pm        RSMHPCANSYSLOCALINSTALL_DIRECTORY=C:\Program Files\ANSYS Inc\v195

355 11/10/2019 1:581 pm        RSMHPCVERSION=195

356 11/10/2019 1:581 pm        RSMHPCSTAGING=\MainCAD\RSMStaging\4w4eooau.l0x

357 11/10/2019 1:581 pm        RSMHPCLOCAL_PLATFORM=Windows

358 11/10/2019 1:581 pm        RSMHPCCLUSTERTARGETPLATFORM=Windows

359 11/10/2019 1:581 pm        RSMHPCSTDOUTFILE=stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

360 11/10/2019 1:581 pm        RSMHPCSTDERRFILE=stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

361 11/10/2019 1:581 pm        RSMHPCSTDOUTLIVE=stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.live

362 11/10/2019 1:581 pm        RSMHPCSTDERRLIVE=stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.live

363 11/10/2019 1:581 pm        RSMHPCSCRIPTSDIRECTORYLOCAL=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts

364 11/10/2019 1:581 pm        RSMHPCSCRIPTSDIRECTORY=%AWPROOT195%\RSM\Config\scripts

365 11/10/2019 1:581 pm        RSMHPCSUBMITHOST=localhost

366 11/10/2019 1:581 pm        RSMHPCSTORAGEID=<JobId>    <id>dc1790b9-6290-4019-9b18-38acc7465469</id>    <nativeId>Mechanical=LocalOS#localhost$\MainCAD\RSMStaging\4w4eooau.l0x</nativeId>    <timestamp>Friday, October 11, 2019 12:580.393 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>

367 11/10/2019 1:581 pm        RSMHPCPLATFORMSTORAGEID=\MainCAD\RSMStaging\4w4eooau.l0x

368 11/10/2019 1:581 pm        RSMHPCNATIVEOPTIONS=

369 11/10/2019 1:581 pm        ARC_ROOT=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts....\ARC

370 11/10/2019 1:581 pm        RSMHPCKEYWORD=ARC

371 11/10/2019 1:581 pm        RSMHPCCOMMAND=clusterjob_3a6b4620-8d29-4665-88a3-df770a04d30d.bat

372 11/10/2019 1:581 pm        RSMHPCPARSE_MARKER=START

373 11/10/2019 1:581 pm ------------------------------------------------------------------------

374 11/10/2019 1:581 pm ArcMaster process running as NT AUTHORITY\SYSTEM

375 11/10/2019 1:581 pm ArcNode process running as NT AUTHORITY\SYSTEM

376 11/10/2019 1:581 pm Skipping autostart because Master processes is started as a service.

377 11/10/2019 1:581 pm Job was successfully submitted as <8>

378 11/10/2019 1:581 pm External cluster command: parseSubmit ---------------------------------------

379 11/10/2019 1:581 pm    Cluster command before expansion: %RSMPYTHONEXE% -B -E "%RSMHPCSCRIPTSDIRECTORYLOCAL%/arcParsing.py" -submit %RSMHPCPARSE_MARKER%

380 11/10/2019 1:581 pm    Final cluster command: C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python\python.exe -B -E "C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts/arcParsing.py" -submit START

381 11/10/2019 1:581 pm    Working directory : \MainCAD\RSMStaging\4w4eooau.l0x

382 11/10/2019 1:581 pm    Variables:

383 11/10/2019 1:581 pm        RSMPYTHONHOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python

384 11/10/2019 1:581 pm        RSMIRONPYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython

385 11/10/2019 1:581 pm        RSMPYTHONEXE=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python\python.exe

386 11/10/2019 1:581 pm        RSMTASKWORKING_DIRECTORY=\MainCAD\RSMStaging\4w4eooau.l0x

387 11/10/2019 1:581 pm        RSMUSESSH_LINUX=False

388 11/10/2019 1:581 pm        RSMQUEUENAME=default

389 11/10/2019 1:581 pm        RSMCONFIGUREDQUEUENAME=Default

390 11/10/2019 1:581 pm        RSMCOMPUTESERVERMACHINENAME=Maincad

391 11/10/2019 1:581 pm        RSMHPCJOBNAME=Mechanical

392 11/10/2019 1:581 pm        RSMHPCDISPLAYNAME=AnnulusThreadMAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)

393 11/10/2019 1:581 pm        RSMHPCCORES=12

394 11/10/2019 1:581 pm        RSMHPCDISTRIBUTED=TRUE

395 11/10/2019 1:581 pm        RSMHPCNODE_EXCLUSIVE=FALSE

396 11/10/2019 1:581 pm        RSMHPCQUEUE=default

397 11/10/2019 1:581 pm        RSMHPCUSER=MAINCAD\User

398 11/10/2019 1:581 pm        RSMHPCWORKDIR=\MainCAD\RSMStaging\4w4eooau.l0x

399 11/10/2019 1:581 pm        RSMHPCJOBTYPE=Mechanical_ANSYS

400 11/10/2019 1:581 pm        RSMHPCANSYSLOCALINSTALL_DIRECTORY=C:\Program Files\ANSYS Inc\v195

401 11/10/2019 1:581 pm        RSMHPCVERSION=195

402 11/10/2019 1:581 pm        RSMHPCSTAGING=\MainCAD\RSMStaging\4w4eooau.l0x

403 11/10/2019 1:581 pm        RSMHPCLOCAL_PLATFORM=Windows

404 11/10/2019 1:581 pm        RSMHPCCLUSTERTARGETPLATFORM=Windows

405 11/10/2019 1:581 pm        RSMHPCSTDOUTFILE=stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

406 11/10/2019 1:581 pm        RSMHPCSTDERRFILE=stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

407 11/10/2019 1:581 pm        RSMHPCSTDOUTLIVE=stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.live

408 11/10/2019 1:581 pm        RSMHPCSTDERRLIVE=stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.live

409 11/10/2019 1:581 pm        RSMHPCSCRIPTSDIRECTORYLOCAL=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts

410 11/10/2019 1:581 pm        RSMHPCSCRIPTSDIRECTORY=%AWPROOT195%\RSM\Config\scripts

411 11/10/2019 1:581 pm        RSMHPCSUBMITHOST=localhost

412 11/10/2019 1:581 pm        RSMHPCSTORAGEID=<JobId>    <id>dc1790b9-6290-4019-9b18-38acc7465469</id>    <nativeId>Mechanical=LocalOS#localhost$\MainCAD\RSMStaging\4w4eooau.l0x</nativeId>    <timestamp>Friday, October 11, 2019 12:580.393 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>

413 11/10/2019 1:581 pm        RSMHPCPLATFORMSTORAGEID=\MainCAD\RSMStaging\4w4eooau.l0x

414 11/10/2019 1:581 pm        RSMHPCNATIVEOPTIONS=

415 11/10/2019 1:581 pm        ARC_ROOT=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts....\ARC

416 11/10/2019 1:581 pm        RSMHPCKEYWORD=ARC

417 11/10/2019 1:581 pm        RSMHPCCOMMAND=clusterjob_3a6b4620-8d29-4665-88a3-df770a04d30d.bat

418 11/10/2019 1:581 pm        RSMHPCPARSE_MARKER=START

419 11/10/2019 1:581 pm        RSMHPCPRIMARY_STDOUT=ArcMaster process running as NT AUTHORITY\SYSTEM

420 11/10/2019 1:581 pm ArcNode process running as NT AUTHORITY\SYSTEM

421 11/10/2019 1:581 pm Skipping autostart because Master processes is started as a service.

422 11/10/2019 1:581 pm Job was successfully submitted as <8>

423 11/10/2019 1:581 pm        RSMHPCPRIMARY_STDERR=

424 11/10/2019 1:581 pm -----------------------------------------------------------------------------

425 11/10/2019 1:581 pm JobId was parsed as: 8

426 11/10/2019 1:581 pm Job submission was successful.

427 11/10/2019 1:586 pm Job is running on hostname Maincad

428 11/10/2019 1:586 pm Job user from this host: User

429 11/10/2019 1:586 pm Starting directory: C:\Windows

430 11/10/2019 1:586 pm Reading control file \MainCAD\RSMStaging\4w4eooau.l0x\control_3a6b4620-8d29-4665-88a3-df770a04d30d.rsm ....

431 11/10/2019 1:586 pm Correct Cluster verified

432 11/10/2019 1:586 pm Cluster Type: ARC

433 11/10/2019 1:586 pm Underlying Cluster: ARC

434 11/10/2019 1:586 pm    RSMCLUSTERTYPE = ARC

435 11/10/2019 1:586 pm Compute Server is running on MAINCAD

436 11/10/2019 1:586 pm Reading commands and arguments...

437 11/10/2019 1:586 pm    Command 1: %AWP_ROOT195%\SEC\SolverExecutionController\runsec.bat, arguments: , redirectFile: None

438 11/10/2019 1:586 pm Running from shared staging directory ...

439 11/10/2019 1:586 pm    RSMUSELOCAL_SCRATCH = False

440 11/10/2019 1:586 pm    RSMLOCALSCRATCH_DIRECTORY =

441 11/10/2019 1:586 pm    RSMLOCALSCRATCHPARTIALUNC_PATH =

442 11/10/2019 1:586 pm Cluster Shared Directory: \MainCAD\RSMStaging\4w4eooau.l0x

443 11/10/2019 1:586 pm    RSMSHARESTAGING_DIRECTORY = \MainCAD\RSMStaging\4w4eooau.l0x

444 11/10/2019 1:586 pm Job file clean up: True

445 11/10/2019 1:586 pm Use SSH on Linux cluster nodes: False

446 11/10/2019 1:586 pm    RSMUSESSH_LINUX = False

447 11/10/2019 1:586 pm LivelogFile: NOLIVELOGFILE

448 11/10/2019 1:586 pm StdoutLiveLogFile: stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.live

449 11/10/2019 1:586 pm StderrLiveLogFile: stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.live

450 11/10/2019 1:586 pm Reading input files...

451 11/10/2019 1:586 pm    *.dat

452 11/10/2019 1:586 pm    file.

453 11/10/2019 1:586 pm    *.mac

454 11/10/2019 1:586 pm    thermal.build

455 11/10/2019 1:586 pm    commands.xml

456 11/10/2019 1:586 pm    SecInput.txt

457 11/10/2019 1:586 pm Reading cancel files...

458 11/10/2019 1:586 pm    file.abt

459 11/10/2019 1:586 pm    sec.interrupt

460 11/10/2019 1:586 pm Reading output files...

461 11/10/2019 1:586 pm    *.xml

462 11/10/2019 1:586 pm    .NR

463 11/10/2019 1:586 pm    CAERepOutput.xml

464 11/10/2019 1:586 pm    cyclic_map.json

465 11/10/2019 1:586 pm    exit.topo

466 11/10/2019 1:586 pm    file*.dsub

467 11/10/2019 1:586 pm    file*.ldhi

468 11/10/2019 1:586 pm    file*.png

469 11/10/2019 1:586 pm    file.r0

470 11/10/2019 1:586 pm    file.r1

471 11/10/2019 1:586 pm    file.r2

472 11/10/2019 1:586 pm    file.r3

473 11/10/2019 1:586 pm    file.r4

474 11/10/2019 1:586 pm    file.r5

475 11/10/2019 1:586 pm    file.r6

476 11/10/2019 1:586 pm    file.r7

477 11/10/2019 1:586 pm    file.r8

478 11/10/2019 1:586 pm    file.r9

479 11/10/2019 1:586 pm    file.rd

480 11/10/2019 1:586 pm    file*.rst

481 11/10/2019 1:586 pm    file.BCS

482 11/10/2019 1:586 pm    file.ce

483 11/10/2019 1:586 pm    file.cm

484 11/10/2019 1:586 pm    file.cnd

485 11/10/2019 1:586 pm    file.cnm

486 11/10/2019 1:586 pm    file.DSP

487 11/10/2019 1:586 pm    file.err

488 11/10/2019 1:586 pm    file.gst

489 11/10/2019 1:586 pm    file.json

490 11/10/2019 1:586 pm    file.nd*

491 11/10/2019 1:586 pm    file.nlh

492 11/10/2019 1:586 pm    file.nr*

493 11/10/2019 1:586 pm    file.PCS

494 11/10/2019 1:586 pm    file.rdb

495 11/10/2019 1:586 pm    file.rfl

496 11/10/2019 1:586 pm    file.spm

497 11/10/2019 1:586 pm    file0.BCS

498 11/10/2019 1:586 pm    file0.ce

499 11/10/2019 1:586 pm    file0.cnd

500 11/10/2019 1:586 pm    file0.err

501 11/10/2019 1:586 pm    file0.gst

502 11/10/2019 1:586 pm    file0.nd*

503 11/10/2019 1:586 pm    file0.nlh

504 11/10/2019 1:586 pm    file0.nr*

505 11/10/2019 1:586 pm    file0.PCS

506 11/10/2019 1:586 pm    frequencies_*.out

507 11/10/2019 1:586 pm    input.x17

508 11/10/2019 1:586 pm    intermediate*.topo

509 11/10/2019 1:586 pm    Modemapping*.txt

510 11/10/2019 1:586 pm    NotSupportedElems.dat

511 11/10/2019 1:586 pm    ObjectiveHistory.out

512 11/10/2019 1:586 pm    post.out

513 11/10/2019 1:586 pm    PostImage*.png

514 11/10/2019 1:586 pm    record.txt

515 11/10/2019 1:586 pm    solve*.out

516 11/10/2019 1:586 pm    topo.err

517 11/10/2019 1:586 pm    toput

518 11/10/2019 1:586 pm    vars.topo

519 11/10/2019 1:586 pm    SecDebugLog.txt

520 11/10/2019 1:586 pm    secStart.log

521 11/10/2019 1:586 pm    sec.validation.executed

522 11/10/2019 1:586 pm    sec.envvarvalidation.executed

523 11/10/2019 1:586 pm    sec.failure

524 11/10/2019 1:586 pm    *.xml

525 11/10/2019 1:586 pm    .NR

526 11/10/2019 1:586 pm    CAERepOutput.xml

527 11/10/2019 1:586 pm    cyclic_map.json

528 11/10/2019 1:586 pm    exit.topo

529 11/10/2019 1:586 pm    file*.dsub

530 11/10/2019 1:586 pm    file*.ldhi

531 11/10/2019 1:586 pm    file*.png

532 11/10/2019 1:586 pm    file.r0

533 11/10/2019 1:586 pm    file.r1

534 11/10/2019 1:586 pm    file.r2

535 11/10/2019 1:586 pm    file.r3

536 11/10/2019 1:586 pm    file.r4

537 11/10/2019 1:586 pm    file.r5

538 11/10/2019 1:586 pm    file.r6

539 11/10/2019 1:586 pm    file.r7

540 11/10/2019 1:586 pm    file.r8

541 11/10/2019 1:586 pm    file.r9

542 11/10/2019 1:586 pm    file.rd

543 11/10/2019 1:586 pm    file*.rst

544 11/10/2019 1:586 pm    file.BCS

545 11/10/2019 1:586 pm    file.ce

546 11/10/2019 1:586 pm    file.cm

547 11/10/2019 1:586 pm    file.cnd

548 11/10/2019 1:586 pm    file.cnm

549 11/10/2019 1:586 pm    file.DSP

550 11/10/2019 1:586 pm    file.err

551 11/10/2019 1:586 pm    file.gst

552 11/10/2019 1:586 pm    file.json

553 11/10/2019 1:586 pm    file.nd*

554 11/10/2019 1:586 pm    file.nlh

555 11/10/2019 1:586 pm    file.nr*

556 11/10/2019 1:586 pm    file.PCS

557 11/10/2019 1:586 pm    file.rdb

558 11/10/2019 1:586 pm    file.rfl

559 11/10/2019 1:586 pm    file.spm

560 11/10/2019 1:586 pm    file0.BCS

561 11/10/2019 1:586 pm    file0.ce

562 11/10/2019 1:586 pm    file0.cnd

563 11/10/2019 1:586 pm    file0.err

564 11/10/2019 1:586 pm    file0.gst

565 11/10/2019 1:586 pm    file0.nd*

566 11/10/2019 1:586 pm    file0.nlh

567 11/10/2019 1:586 pm    file0.nr*

568 11/10/2019 1:586 pm    file0.PCS

569 11/10/2019 1:586 pm    frequencies_*.out

570 11/10/2019 1:586 pm    input.x17

571 11/10/2019 1:586 pm    intermediate*.topo

572 11/10/2019 1:586 pm    Modemapping*.txt

573 11/10/2019 1:586 pm    NotSupportedElems.dat

574 11/10/2019 1:586 pm    ObjectiveHistory.out

575 11/10/2019 1:586 pm    post.out

576 11/10/2019 1:586 pm    PostImage*.png

577 11/10/2019 1:586 pm    record.txt

578 11/10/2019 1:586 pm    solve*.out

579 11/10/2019 1:586 pm    topo.err

580 11/10/2019 1:586 pm    toput

581 11/10/2019 1:586 pm    vars.topo

582 11/10/2019 1:586 pm    SecDebugLog.txt

583 11/10/2019 1:586 pm    sec.solverexitcode

584 11/10/2019 1:586 pm    secStart.log

585 11/10/2019 1:586 pm    sec.failure

586 11/10/2019 1:586 pm    sec.envvarvalidation.executed

587 11/10/2019 1:586 pm Reading exclude files...

588 11/10/2019 1:586 pm    stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

589 11/10/2019 1:586 pm    stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

590 11/10/2019 1:586 pm    control_3a6b4620-8d29-4665-88a3-df770a04d30d.rsm

591 11/10/2019 1:586 pm    hosts.dat

592 11/10/2019 1:586 pm    exitcode_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

593 11/10/2019 1:586 pm    exitcodeCommands_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

594 11/10/2019 1:586 pm    stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.live

595 11/10/2019 1:586 pm    stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.live

596 11/10/2019 1:586 pm    ClusterJobCustomization.xml

597 11/10/2019 1:586 pm    ClusterJobs.py

598 11/10/2019 1:586 pm    clusterjob_3a6b4620-8d29-4665-88a3-df770a04d30d.sh

599 11/10/2019 1:586 pm    clusterjob_3a6b4620-8d29-4665-88a3-df770a04d30d.bat

600 11/10/2019 1:586 pm    inquire.request

601 11/10/2019 1:586 pm    inquire.confirm

602 11/10/2019 1:586 pm    request.upload.rsm

603 11/10/2019 1:586 pm    request.download.rsm

604 11/10/2019 1:586 pm    wait.download.rsm

605 11/10/2019 1:586 pm    scratch.job.rsm

606 11/10/2019 1:586 pm    volatile.job.rsm

607 11/10/2019 1:586 pm    restart.xml

608 11/10/2019 1:586 pm    cancel_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

609 11/10/2019 1:586 pm    liveLogLastPositions_3a6b4620-8d29-4665-88a3-df770a04d30d.rsm

610 11/10/2019 1:586 pm    stdout3a6b4620-8d29-4665-88a3-df770a04d30dkill.rsmout

611 11/10/2019 1:586 pm    stderr3a6b4620-8d29-4665-88a3-df770a04d30dkill.rsmout

612 11/10/2019 1:586 pm    sec.interrupt

613 11/10/2019 1:586 pm    stdout3a6b4620-8d29-4665-88a3-df770a04d30d*.rsmout

614 11/10/2019 1:586 pm    stderr3a6b4620-8d29-4665-88a3-df770a04d30d*.rsmout

615 11/10/2019 1:586 pm    stdouttask*.live

616 11/10/2019 1:586 pm    stderrtask*.live

617 11/10/2019 1:586 pm    controltask*.rsm

618 11/10/2019 1:586 pm    stdouttask*.rsmout

619 11/10/2019 1:586 pm    stderrtask*.rsmout

620 11/10/2019 1:586 pm    exitcodetask*.rsmout

621 11/10/2019 1:586 pm    exitcodeCommandstask*.rsmout

622 11/10/2019 1:586 pm    file.abt

623 11/10/2019 1:586 pm Reading environment variables...

624 11/10/2019 1:586 pm    RSMIRONPYTHON_HOME = C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython

625 11/10/2019 1:586 pm    RSMTASKWORKING_DIRECTORY = \MainCAD\RSMStaging\4w4eooau.l0x

626 11/10/2019 1:586 pm    RSMUSESSH_LINUX = False

627 11/10/2019 1:586 pm    RSMQUEUENAME = default

628 11/10/2019 1:586 pm    RSMCONFIGUREDQUEUENAME = Default

629 11/10/2019 1:586 pm    RSMCOMPUTESERVERMACHINENAME = Maincad

630 11/10/2019 1:586 pm    RSMHPCJOBNAME = Mechanical

631 11/10/2019 1:586 pm    RSMHPCDISPLAYNAME = AnnulusThreadMAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)

632 11/10/2019 1:586 pm    RSMHPCCORES = 12

633 11/10/2019 1:586 pm    RSMHPCDISTRIBUTED = TRUE

634 11/10/2019 1:586 pm    RSMHPCNODE_EXCLUSIVE = FALSE

635 11/10/2019 1:586 pm    RSMHPCQUEUE = default

636 11/10/2019 1:586 pm    RSMHPCUSER = MAINCAD\User

637 11/10/2019 1:586 pm    RSMHPCWORKDIR = \MainCAD\RSMStaging\4w4eooau.l0x

638 11/10/2019 1:586 pm    RSMHPCJOBTYPE = Mechanical_ANSYS

639 11/10/2019 1:586 pm    RSMHPCANSYSLOCALINSTALL_DIRECTORY = C:\Program Files\ANSYS Inc\v195

640 11/10/2019 1:586 pm    RSMHPCVERSION = 195

641 11/10/2019 1:586 pm    RSMHPCSTAGING = \MainCAD\RSMStaging\4w4eooau.l0x

642 11/10/2019 1:586 pm    RSMHPCLOCAL_PLATFORM = Windows

643 11/10/2019 1:586 pm    RSMHPCCLUSTERTARGETPLATFORM = Windows

644 11/10/2019 1:586 pm    RSMHPCSTDOUTFILE = stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

645 11/10/2019 1:586 pm    RSMHPCSTDERRFILE = stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

646 11/10/2019 1:586 pm    RSMHPCSTDOUTLIVE = stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.live

647 11/10/2019 1:586 pm    RSMHPCSTDERRLIVE = stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.live

648 11/10/2019 1:586 pm    RSMHPCSCRIPTSDIRECTORYLOCAL = C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts

649 11/10/2019 1:586 pm    RSMHPCSCRIPTS_DIRECTORY = C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts

650 11/10/2019 1:586 pm    RSMHPCSUBMITHOST = localhost

651 11/10/2019 1:586 pm    RSMHPCSTORAGEID = <JobId>    <id>dc1790b9-6290-4019-9b18-38acc7465469</id>    <nativeId>Mechanical=LocalOS#localhost$\MainCAD\RSMStaging\4w4eooau.l0x</nativeId>    <timestamp>Friday, October 11, 2019 12:580.393 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>

652 11/10/2019 1:586 pm    RSMHPCPLATFORMSTORAGEID = \MainCAD\RSMStaging\4w4eooau.l0x

653 11/10/2019 1:586 pm    RSMHPCNATIVEOPTIONS =

654 11/10/2019 1:586 pm    ARC_ROOT = C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts....\ARC

655 11/10/2019 1:586 pm    RSMHPCKEYWORD = ARC

656 11/10/2019 1:586 pm    RSMPYTHONLOCALE = en-us

657 11/10/2019 1:586 pm Reading AWP_ROOT environment variable name ...

658 11/10/2019 1:586 pm    AWPROOT environment variable name is: AWPROOT195

659 11/10/2019 1:586 pm Reading Low Disk Space Warning Limit ...

660 11/10/2019 1:586 pm    Low disk space warning threshold set at: 2.0GiB

661 11/10/2019 1:586 pm Reading File identifier ...

662 11/10/2019 1:586 pm    File identifier found as: 3a6b4620-8d29-4665-88a3-df770a04d30d

663 11/10/2019 1:586 pm Done reading control file.

664 11/10/2019 1:586 pm RSMAWPROOTNAME = AWPROOT195

665 11/10/2019 1:586 pm AWP_ROOT195 install directory: C:\Program Files\ANSYS Inc\v195

666 11/10/2019 1:586 pm RSM_MACHINES = maincad:4:cluster01:4:cluster02:4

667 11/10/2019 1:586 pm Number of nodes assigned for current job = 3

668 11/10/2019 1:586 pm Machine list: ['maincad', 'cluster01', 'cluster02']

669 11/10/2019 1:586 pm Checking DisableUNCCheck ...

670 11/10/2019 1:586 pm Unable to read registry for HKEYCURRENTUSER\Software\Microsoft\Command Processor

671 11/10/2019 1:586 pm Ignore verifying DisableUNCCheck, you may check it manually if not already done so.

672 11/10/2019 1:586 pm Start running job commands ...

673 11/10/2019 1:586 pm Running on machine : Maincad

674 11/10/2019 1:586 pm Current Directory: \MainCAD\RSMStaging\4w4eooau.l0x

675 11/10/2019 1:586 pm Running command: C:\Program Files\ANSYS Inc\v195\SEC\SolverExecutionController\runsec.bat

676 11/10/2019 1:586 pm Redirecting output to  None

677 11/10/2019 1:586 pm Final command arg list : ['C:\Program Files\ANSYS Inc\v195\SEC\SolverExecutionController\runsec.bat']

678 11/10/2019 1:586 pm Running Process

679 11/10/2019 1:586 pm Command Exit Code: 1

680 11/10/2019 1:586 pm Saving exit code file: \MainCAD\RSMStaging\4w4eooau.l0x\exitcode_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

681 11/10/2019 1:586 pm    Exit code file: \MainCAD\RSMStaging\4w4eooau.l0x\exitcode_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout has been created.

682 11/10/2019 1:586 pm Saving exit code file: \MainCAD\RSMStaging\4w4eooau.l0x\exitcodeCommands_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

683 11/10/2019 1:586 pm    Exit code file: \MainCAD\RSMStaging\4w4eooau.l0x\exitcodeCommands_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout has been created.

684 11/10/2019 1:586 pm ClusterJobs Exiting with code: 1

685 11/10/2019 1:586 pm Individual Command Exit Codes are: [1]

686 11/10/2019 1:586 pm '\MainCAD\RSMStaging\4w4eooau.l0x'

687 11/10/2019 1:586 pm CMD.EXE was started with the above path as the current directory.

688 11/10/2019 1:586 pm UNC paths are not supported.  Defaulting to Windows directory.

689 11/10/2019 1:586 pm Traceback (most recent call last):

690 11/10/2019 1:586 pm  File "C:\Program Files\ANSYS Inc\v195\SEC\SolverExecutionController\runsec.py", line 34, in <module>

691 11/10/2019 1:586 pm    main(sys.argv)

692 11/10/2019 1:586 pm  File "C:\Program Files\ANSYS Inc\v195\SEC\SolverExecutionController\runsec.py", line 14, in main

693 11/10/2019 1:586 pm    return dynamicMain(args)

694 11/10/2019 1:586 pm  File "C:\Program Files\ANSYS Inc\v195\SEC\SolverExecutionController\runsec.py", line 31, in dynamicMain

695 11/10/2019 1:586 pm    return sec.sec.execute(runScriptFilePath=file)

696 11/10/2019 1:586 pm  File "C:\Program Files\ANSYS Inc\v195\SEC\SolverExecutionController\sec\sec.py", line 713, in execute

697 11/10/2019 1:586 pm    inputAndModifierPair = readInputDataAndModifierDictionaries(dirTuple[1], inputFileName)

698 11/10/2019 1:586 pm  File "C:\Program Files\ANSYS Inc\v195\SEC\SolverExecutionController\sec\sec.py", line 1231, in readInputDataAndModifierDictionaries

699 11/10/2019 1:586 pm    inputFile = open(os.path.join(workingDir, inputFileName), 'r')

700 11/10/2019 1:586 pm IOError: [Errno 2] No such file or directory: 'C:\Windows\SecInput.txt'

701 11/10/2019 1:586 pm External cluster command: queryStatus ---------------------------------------

702 11/10/2019 1:586 pm    Cluster command before expansion: %ARCROOT%\bin\ArcStatus.exe %RSMHPC_JOBID%

703 11/10/2019 1:586 pm    Final cluster command: C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts....\ARC\bin\ArcStatus.exe 8

704 11/10/2019 1:586 pm    Working directory : \MainCAD\RSMStaging\4w4eooau.l0x

705 11/10/2019 1:586 pm    Variables:

706 11/10/2019 1:586 pm        RSMPYTHONHOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python

707 11/10/2019 1:586 pm        RSMIRONPYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython

708 11/10/2019 1:586 pm        RSMPYTHONEXE=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python\python.exe

709 11/10/2019 1:586 pm        RSMTASKWORKING_DIRECTORY=\MainCAD\RSMStaging\4w4eooau.l0x

710 11/10/2019 1:586 pm        RSMUSESSH_LINUX=False

711 11/10/2019 1:586 pm        RSMQUEUENAME=default

712 11/10/2019 1:586 pm        RSMCONFIGUREDQUEUENAME=Default

713 11/10/2019 1:586 pm        RSMCOMPUTESERVERMACHINENAME=Maincad

714 11/10/2019 1:586 pm        RSMHPCJOBNAME=Mechanical

715 11/10/2019 1:586 pm        RSMHPCDISPLAYNAME=AnnulusThreadMAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)

716 11/10/2019 1:586 pm        RSMHPCDIRECTORY_SHARED=FALSE

717 11/10/2019 1:586 pm        RSMHPCUSER=MAINCAD\User

718 11/10/2019 1:586 pm        RSMHPCWORKDIR=\MainCAD\RSMStaging\4w4eooau.l0x

719 11/10/2019 1:586 pm        RSMHPCJOBTYPE=Mechanical_ANSYS

720 11/10/2019 1:586 pm        RSMHPCANSYSLOCALINSTALL_DIRECTORY=C:\Program Files\ANSYS Inc\v195

721 11/10/2019 1:586 pm        RSMHPCVERSION=195

722 11/10/2019 1:586 pm        RSMHPCSTAGING=\MainCAD\RSMStaging\4w4eooau.l0x

723 11/10/2019 1:586 pm        RSMHPCLOCAL_PLATFORM=Windows

724 11/10/2019 1:586 pm        RSMHPCCLUSTERTARGETPLATFORM=Windows

725 11/10/2019 1:586 pm        RSMHPCSTDOUTFILE=stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

726 11/10/2019 1:586 pm        RSMHPCSTDERRFILE=stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

727 11/10/2019 1:586 pm        RSMHPCSTDOUTLIVE=stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.live

728 11/10/2019 1:586 pm        RSMHPCSTDERRLIVE=stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.live

729 11/10/2019 1:586 pm        RSMHPCSCRIPTSDIRECTORYLOCAL=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts

730 11/10/2019 1:586 pm        RSMHPCSCRIPTSDIRECTORY=%AWPROOT195%\RSM\Config\scripts

731 11/10/2019 1:586 pm        RSMHPCSUBMITHOST=localhost

732 11/10/2019 1:586 pm        RSMHPCSTORAGEID=<JobId>    <id>dc1790b9-6290-4019-9b18-38acc7465469</id>    <nativeId>Mechanical=LocalOS#localhost$\MainCAD\RSMStaging\4w4eooau.l0x</nativeId>    <timestamp>Friday, October 11, 2019 12:580.393 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>

733 11/10/2019 1:586 pm        RSMHPCPLATFORMSTORAGEID=\MainCAD\RSMStaging\4w4eooau.l0x

734 11/10/2019 1:586 pm        RSMHPCNATIVEOPTIONS=

735 11/10/2019 1:586 pm        ARC_ROOT=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts....\ARC

736 11/10/2019 1:586 pm        RSMHPCKEYWORD=ARC

737 11/10/2019 1:586 pm        RSMHPCJOBID=8

738 11/10/2019 1:586 pm        RSMHPCPARSE_MARKER=START

739 11/10/2019 1:586 pm -----------------------------------------------------------------------------

740 11/10/2019 1:587 pm Status of Job <8> is <Failed>

741 11/10/2019 1:587 pm ----------------------------

742 11/10/2019 1:587 pm JobNumber           8

743 11/10/2019 1:587 pm Status              Failed

744 11/10/2019 1:587 pm UserName            MAINCAD\User

745 11/10/2019 1:587 pm Cores               12

746 11/10/2019 1:587 pm Submit Time         10/11/2019 13:581

747 11/10/2019 1:587 pm Queue               default

748 11/10/2019 1:587 pm Assigned Machines   maincad:4:cluster01:4:cluster02:4

749 11/10/2019 1:587 pm Info                Error: Exitcode: 1

750 11/10/2019 1:587 pm Error File: '\MainCAD\RSMStaging\4w4eooau.l0x'

751 11/10/2019 1:587 pm CMD.EXE was started with the above path as the current directory.

752 11/10/2019 1:587 pm UNC paths are not supported.  Defaulting to Windows directory.

753 11/10/2019 1:587 pm Last 15 lines of Output File:

754 11/10/2019 1:587 pm Job started on MAINCAD

755 11/10/2019 1:587 pm ClusterSharedDirectory=\MainCAD\RSMStaging\4w4eooau.l0x

756 11/10/2019 1:587 pm AWP_ROOT195=C:\Program Files\ANSYS Inc\v195

757 11/10/2019 1:587 pm Command=C:\Program Files\ANSYS Inc\v195/commonfiles/CPython/2715/winx64/Release/python/python.exe

758 11/10/2019 1:587 pm running the commmand

759 11/10/2019 1:587 pm command: "C:\Program Files\ANSYS Inc\v195/commonfiles/CPython/2715/winx64/Release/python/python.exe" -B -E "C:\Program Files\ANSYS Inc\v195/RSM/Config/scripts/ClusterJobs.py" "\MainCAD\RSMStaging\4w4eooau.l0x\control_3a6b4620-8d29-4665-88a3-df770a04d30d.rsm"

760 11/10/2019 1:587 pm External cluster command: parseStatus ---------------------------------------

761 11/10/2019 1:587 pm    Cluster command before expansion: %RSMPYTHONEXE% -B -E "%RSMHPCSCRIPTSDIRECTORYLOCAL%/arcParsing.py" -status %RSMHPCPARSE_MARKER%

762 11/10/2019 1:587 pm    Final cluster command: C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python\python.exe -B -E "C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts/arcParsing.py" -status START

763 11/10/2019 1:587 pm    Working directory : \MainCAD\RSMStaging\4w4eooau.l0x

764 11/10/2019 1:587 pm    Variables:

765 11/10/2019 1:587 pm        RSMPYTHONHOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python

766 11/10/2019 1:587 pm        RSMIRONPYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython

767 11/10/2019 1:587 pm        RSMPYTHONEXE=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python\python.exe

768 11/10/2019 1:587 pm        RSMTASKWORKING_DIRECTORY=\MainCAD\RSMStaging\4w4eooau.l0x

769 11/10/2019 1:587 pm        RSMUSESSH_LINUX=False

770 11/10/2019 1:587 pm        RSMQUEUENAME=default

771 11/10/2019 1:587 pm        RSMCONFIGUREDQUEUENAME=Default

772 11/10/2019 1:587 pm        RSMCOMPUTESERVERMACHINENAME=Maincad

773 11/10/2019 1:587 pm        RSMHPCJOBNAME=Mechanical

774 11/10/2019 1:587 pm        RSMHPCDISPLAYNAME=AnnulusThreadMAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)

775 11/10/2019 1:587 pm        RSMHPCDIRECTORY_SHARED=FALSE

776 11/10/2019 1:587 pm        RSMHPCUSER=MAINCAD\User

777 11/10/2019 1:587 pm        RSMHPCWORKDIR=\MainCAD\RSMStaging\4w4eooau.l0x

778 11/10/2019 1:587 pm        RSMHPCJOBTYPE=Mechanical_ANSYS

779 11/10/2019 1:587 pm        RSMHPCANSYSLOCALINSTALL_DIRECTORY=C:\Program Files\ANSYS Inc\v195

780 11/10/2019 1:587 pm        RSMHPCVERSION=195

781 11/10/2019 1:587 pm        RSMHPCSTAGING=\MainCAD\RSMStaging\4w4eooau.l0x

782 11/10/2019 1:587 pm        RSMHPCLOCAL_PLATFORM=Windows

783 11/10/2019 1:587 pm        RSMHPCCLUSTERTARGETPLATFORM=Windows

784 11/10/2019 1:587 pm        RSMHPCSTDOUTFILE=stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

785 11/10/2019 1:587 pm        RSMHPCSTDERRFILE=stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

786 11/10/2019 1:587 pm        RSMHPCSTDOUTLIVE=stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.live

787 11/10/2019 1:587 pm        RSMHPCSTDERRLIVE=stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.live

788 11/10/2019 1:587 pm        RSMHPCSCRIPTSDIRECTORYLOCAL=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts

789 11/10/2019 1:587 pm        RSMHPCSCRIPTSDIRECTORY=%AWPROOT195%\RSM\Config\scripts

790 11/10/2019 1:587 pm        RSMHPCSUBMITHOST=localhost

791 11/10/2019 1:587 pm        RSMHPCSTORAGEID=<JobId>    <id>dc1790b9-6290-4019-9b18-38acc7465469</id>    <nativeId>Mechanical=LocalOS#localhost$\MainCAD\RSMStaging\4w4eooau.l0x</nativeId>    <timestamp>Friday, October 11, 2019 12:580.393 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>

792 11/10/2019 1:587 pm        RSMHPCPLATFORMSTORAGEID=\MainCAD\RSMStaging\4w4eooau.l0x

793 11/10/2019 1:587 pm        RSMHPCNATIVEOPTIONS=

794 11/10/2019 1:587 pm        ARC_ROOT=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts....\ARC

795 11/10/2019 1:587 pm        RSMHPCKEYWORD=ARC

796 11/10/2019 1:587 pm        RSMHPCJOBID=8

797 11/10/2019 1:587 pm        RSMHPCPARSE_MARKER=START

798 11/10/2019 1:587 pm        RSMHPCPRIMARY_STDOUT=Status of Job <8> is <Failed>

799 11/10/2019 1:587 pm ----------------------------

800 11/10/2019 1:587 pm JobNumber           8

801 11/10/2019 1:587 pm Status              Failed

802 11/10/2019 1:587 pm UserName            MAINCAD\User

803 11/10/2019 1:587 pm Cores               12

804 11/10/2019 1:587 pm Submit Time         10/11/2019 13:581

805 11/10/2019 1:587 pm Queue               default

806 11/10/2019 1:587 pm Assigned Machines   maincad:4:cluster01:4:cluster02:4

807 11/10/2019 1:587 pm Info                Error: Exitcode: 1

808 11/10/2019 1:587 pm Error File: '\MainCAD\RSMStaging\4w4eooau.l0x'

809 11/10/2019 1:587 pm CMD.EXE was started with the above path as the current directory.

810 11/10/2019 1:587 pm UNC paths are not supported.  Defaulting to Windows directory.

811 11/10/2019 1:587 pm Last 15 lines of Output File:

812 11/10/2019 1:587 pm Job started on MAINCAD

813 11/10/2019 1:587 pm ClusterSharedDirectory=\MainCAD\RSMStaging\4w4eooau.l0x

814 11/10/2019 1:587 pm AWP_ROOT195=C:\Program Files\ANSYS Inc\v195

815 11/10/2019 1:587 pm Command=C:\Program Files\ANSYS Inc\v195/commonfiles/CPython/2715/winx64/Release/python/python.exe

816 11/10/2019 1:587 pm running the commmand

817 11/10/2019 1:587 pm command: "C:\Program Files\ANSYS Inc\v195/commonfiles/CPython/2715/winx64/Release/python/python.exe" -B -E "C:\Program Files\ANSYS Inc\v195/RSM/Config/scripts/ClusterJobs.py" "\MainCAD\RSMStaging\4w4eooau.l0x\control_3a6b4620-8d29-4665-88a3-df770a04d30d.rsm"

818 11/10/2019 1:587 pm        RSMHPCPRIMARY_STDERR=

819 11/10/2019 1:587 pm -----------------------------------------------------------------------------

820 11/10/2019 1:587 pm ClusterJobs Command Exit Code: 1

821 11/10/2019 1:587 pm External cluster command: queryStatus ---------------------------------------

822 11/10/2019 1:587 pm    Cluster command before expansion: %ARCROOT%\bin\ArcStatus.exe %RSMHPC_JOBID%

823 11/10/2019 1:587 pm    Final cluster command: C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts....\ARC\bin\ArcStatus.exe 8

824 11/10/2019 1:587 pm    Working directory : \MainCAD\RSMStaging\4w4eooau.l0x

825 11/10/2019 1:587 pm    Variables:

826 11/10/2019 1:587 pm        RSMPYTHONHOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python

827 11/10/2019 1:587 pm        RSMIRONPYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython

828 11/10/2019 1:587 pm        RSMPYTHONEXE=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python\python.exe

829 11/10/2019 1:587 pm        RSMTASKWORKING_DIRECTORY=\MainCAD\RSMStaging\4w4eooau.l0x

830 11/10/2019 1:587 pm        RSMUSESSH_LINUX=False

831 11/10/2019 1:587 pm        RSMQUEUENAME=default

832 11/10/2019 1:587 pm        RSMCONFIGUREDQUEUENAME=Default

833 11/10/2019 1:587 pm        RSMCOMPUTESERVERMACHINENAME=Maincad

834 11/10/2019 1:587 pm        RSMHPCJOBNAME=Mechanical

835 11/10/2019 1:587 pm        RSMHPCDISPLAYNAME=AnnulusThreadMAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)

836 11/10/2019 1:587 pm        RSMHPCDIRECTORY_SHARED=FALSE

837 11/10/2019 1:587 pm        RSMHPCUSER=MAINCAD\User

838 11/10/2019 1:587 pm        RSMHPCWORKDIR=\MainCAD\RSMStaging\4w4eooau.l0x

839 11/10/2019 1:587 pm        RSMHPCJOBTYPE=Mechanical_ANSYS

840 11/10/2019 1:587 pm        RSMHPCANSYSLOCALINSTALL_DIRECTORY=C:\Program Files\ANSYS Inc\v195

841 11/10/2019 1:587 pm        RSMHPCVERSION=195

842 11/10/2019 1:587 pm        RSMHPCSTAGING=\MainCAD\RSMStaging\4w4eooau.l0x

843 11/10/2019 1:587 pm        RSMHPCLOCAL_PLATFORM=Windows

844 11/10/2019 1:587 pm        RSMHPCCLUSTERTARGETPLATFORM=Windows

845 11/10/2019 1:587 pm        RSMHPCSTDOUTFILE=stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

846 11/10/2019 1:587 pm        RSMHPCSTDERRFILE=stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

847 11/10/2019 1:587 pm        RSMHPCSTDOUTLIVE=stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.live

848 11/10/2019 1:587 pm        RSMHPCSTDERRLIVE=stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.live

849 11/10/2019 1:587 pm        RSMHPCSCRIPTSDIRECTORYLOCAL=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts

850 11/10/2019 1:587 pm        RSMHPCSCRIPTSDIRECTORY=%AWPROOT195%\RSM\Config\scripts

851 11/10/2019 1:587 pm        RSMHPCSUBMITHOST=localhost

852 11/10/2019 1:587 pm        RSMHPCSTORAGEID=<JobId>    <id>dc1790b9-6290-4019-9b18-38acc7465469</id>    <nativeId>Mechanical=LocalOS#localhost$\MainCAD\RSMStaging\4w4eooau.l0x</nativeId>    <timestamp>Friday, October 11, 2019 12:580.393 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>

853 11/10/2019 1:587 pm        RSMHPCPLATFORMSTORAGEID=\MainCAD\RSMStaging\4w4eooau.l0x

854 11/10/2019 1:587 pm        RSMHPCNATIVEOPTIONS=

855 11/10/2019 1:587 pm        ARC_ROOT=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts....\ARC

856 11/10/2019 1:587 pm        RSMHPCKEYWORD=ARC

857 11/10/2019 1:587 pm        RSMHPCJOBID=8

858 11/10/2019 1:587 pm        RSMHPCPARSE_MARKER=START

859 11/10/2019 1:587 pm -----------------------------------------------------------------------------

860 11/10/2019 1:587 pm Status of Job <8> is <Failed>

861 11/10/2019 1:587 pm ----------------------------

862 11/10/2019 1:587 pm JobNumber           8

863 11/10/2019 1:587 pm Status              Failed

864 11/10/2019 1:587 pm UserName            MAINCAD\User

865 11/10/2019 1:587 pm Cores               12

866 11/10/2019 1:587 pm Submit Time         10/11/2019 13:581

867 11/10/2019 1:587 pm Queue               default

868 11/10/2019 1:587 pm Assigned Machines   maincad:4:cluster01:4:cluster02:4

869 11/10/2019 1:587 pm Info                Error: Exitcode: 1

870 11/10/2019 1:587 pm Error File: '\MainCAD\RSMStaging\4w4eooau.l0x'

871 11/10/2019 1:587 pm CMD.EXE was started with the above path as the current directory.

872 11/10/2019 1:587 pm UNC paths are not supported.  Defaulting to Windows directory.

873 11/10/2019 1:587 pm Last 15 lines of Output File:

874 11/10/2019 1:587 pm Job started on MAINCAD

875 11/10/2019 1:587 pm ClusterSharedDirectory=\MainCAD\RSMStaging\4w4eooau.l0x

876 11/10/2019 1:587 pm AWP_ROOT195=C:\Program Files\ANSYS Inc\v195

877 11/10/2019 1:587 pm Command=C:\Program Files\ANSYS Inc\v195/commonfiles/CPython/2715/winx64/Release/python/python.exe

878 11/10/2019 1:587 pm running the commmand

879 11/10/2019 1:587 pm command: "C:\Program Files\ANSYS Inc\v195/commonfiles/CPython/2715/winx64/Release/python/python.exe" -B -E "C:\Program Files\ANSYS Inc\v195/RSM/Config/scripts/ClusterJobs.py" "\MainCAD\RSMStaging\4w4eooau.l0x\control_3a6b4620-8d29-4665-88a3-df770a04d30d.rsm"

880 11/10/2019 1:587 pm External cluster command: parseStatus ---------------------------------------

881 11/10/2019 1:587 pm    Cluster command before expansion: %RSMPYTHONEXE% -B -E "%RSMHPCSCRIPTSDIRECTORYLOCAL%/arcParsing.py" -status %RSMHPCPARSE_MARKER%

882 11/10/2019 1:587 pm    Final cluster command: C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python\python.exe -B -E "C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts/arcParsing.py" -status START

883 11/10/2019 1:587 pm    Working directory : \MainCAD\RSMStaging\4w4eooau.l0x

884 11/10/2019 1:587 pm    Variables:

885 11/10/2019 1:587 pm        RSMPYTHONHOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python

886 11/10/2019 1:587 pm        RSMIRONPYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython

887 11/10/2019 1:587 pm        RSMPYTHONEXE=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2715\winx64\Release\python\python.exe

888 11/10/2019 1:587 pm        RSMTASKWORKING_DIRECTORY=\MainCAD\RSMStaging\4w4eooau.l0x

889 11/10/2019 1:587 pm        RSMUSESSH_LINUX=False

890 11/10/2019 1:587 pm        RSMQUEUENAME=default

891 11/10/2019 1:587 pm        RSMCONFIGUREDQUEUENAME=Default

892 11/10/2019 1:587 pm        RSMCOMPUTESERVERMACHINENAME=Maincad

893 11/10/2019 1:587 pm        RSMHPCJOBNAME=Mechanical

894 11/10/2019 1:587 pm        RSMHPCDISPLAYNAME=AnnulusThreadMAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)

895 11/10/2019 1:587 pm        RSMHPCDIRECTORY_SHARED=FALSE

896 11/10/2019 1:587 pm        RSMHPCUSER=MAINCAD\User

897 11/10/2019 1:587 pm        RSMHPCWORKDIR=\MainCAD\RSMStaging\4w4eooau.l0x

898 11/10/2019 1:587 pm        RSMHPCJOBTYPE=Mechanical_ANSYS

899 11/10/2019 1:587 pm        RSMHPCANSYSLOCALINSTALL_DIRECTORY=C:\Program Files\ANSYS Inc\v195

900 11/10/2019 1:587 pm        RSMHPCVERSION=195

901 11/10/2019 1:587 pm        RSMHPCSTAGING=\MainCAD\RSMStaging\4w4eooau.l0x

902 11/10/2019 1:587 pm        RSMHPCLOCAL_PLATFORM=Windows

903 11/10/2019 1:587 pm        RSMHPCCLUSTERTARGETPLATFORM=Windows

904 11/10/2019 1:587 pm        RSMHPCSTDOUTFILE=stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

905 11/10/2019 1:587 pm        RSMHPCSTDERRFILE=stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.rsmout

906 11/10/2019 1:587 pm        RSMHPCSTDOUTLIVE=stdout_3a6b4620-8d29-4665-88a3-df770a04d30d.live

907 11/10/2019 1:587 pm        RSMHPCSTDERRLIVE=stderr_3a6b4620-8d29-4665-88a3-df770a04d30d.live

908 11/10/2019 1:587 pm        RSMHPCSCRIPTSDIRECTORYLOCAL=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts

909 11/10/2019 1:587 pm        RSMHPCSCRIPTSDIRECTORY=%AWPROOT195%\RSM\Config\scripts

910 11/10/2019 1:587 pm        RSMHPCSUBMITHOST=localhost

911 11/10/2019 1:587 pm        RSMHPCSTORAGEID=<JobId>    <id>dc1790b9-6290-4019-9b18-38acc7465469</id>    <nativeId>Mechanical=LocalOS#localhost$\MainCAD\RSMStaging\4w4eooau.l0x</nativeId>    <timestamp>Friday, October 11, 2019 12:580.393 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>

912 11/10/2019 1:587 pm        RSMHPCPLATFORMSTORAGEID=\MainCAD\RSMStaging\4w4eooau.l0x

913 11/10/2019 1:587 pm        RSMHPCNATIVEOPTIONS=

914 11/10/2019 1:587 pm        ARC_ROOT=C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts....\ARC

915 11/10/2019 1:587 pm        RSMHPCKEYWORD=ARC

916 11/10/2019 1:587 pm        RSMHPCJOBID=8

917 11/10/2019 1:587 pm        RSMHPCPARSE_MARKER=START

918 11/10/2019 1:587 pm        RSMHPCPRIMARY_STDOUT=Status of Job <8> is <Failed>

919 11/10/2019 1:587 pm ----------------------------

920 11/10/2019 1:587 pm JobNumber           8

921 11/10/2019 1:587 pm Status              Failed

922 11/10/2019 1:587 pm UserName            MAINCAD\User

923 11/10/2019 1:587 pm Cores               12

924 11/10/2019 1:587 pm Submit Time         10/11/2019 13:581

925 11/10/2019 1:587 pm Queue               default

926 11/10/2019 1:587 pm Assigned Machines   maincad:4:cluster01:4:cluster02:4

927 11/10/2019 1:587 pm Info                Error: Exitcode: 1

928 11/10/2019 1:587 pm Error File: '\MainCAD\RSMStaging\4w4eooau.l0x'

929 11/10/2019 1:587 pm CMD.EXE was started with the above path as the current directory.

930 11/10/2019 1:587 pm UNC paths are not supported.  Defaulting to Windows directory.

931 11/10/2019 1:587 pm Last 15 lines of Output File:

932 11/10/2019 1:587 pm Job started on MAINCAD

933 11/10/2019 1:587 pm ClusterSharedDirectory=\MainCAD\RSMStaging\4w4eooau.l0x

934 11/10/2019 1:587 pm AWP_ROOT195=C:\Program Files\ANSYS Inc\v195

935 11/10/2019 1:587 pm Command=C:\Program Files\ANSYS Inc\v195/commonfiles/CPython/2715/winx64/Release/python/python.exe

936 11/10/2019 1:587 pm running the commmand

937 11/10/2019 1:587 pm command: "C:\Program Files\ANSYS Inc\v195/commonfiles/CPython/2715/winx64/Release/python/python.exe" -B -E "C:\Program Files\ANSYS Inc\v195/RSM/Config/scripts/ClusterJobs.py" "\MainCAD\RSMStaging\4w4eooau.l0x\control_3a6b4620-8d29-4665-88a3-df770a04d30d.rsm"

938 11/10/2019 1:587 pm        RSMHPCPRIMARY_STDERR=

939 11/10/2019 1:587 pm -----------------------------------------------------------------------------

940 11/10/2019 1:587 pm ClusterJobs Command Exit Code: 1

941 11/10/2019 2:072 pm Status query received, but job status is terminal. No need to query cluster.

942 11/10/2019 2:10:27 pm Status query received, but job status is terminal. No need to query cluster.

943 11/10/2019 2:16:23 pm Status query received, but job status is terminal. No need to query cluster.

kolyan007 posted this 10 October 2019

That shared folder exists on maincad and has full access to everyone.

>If you are trying to distribute across multiple machines your staging directory can't be a local drive "c:" - Does it applies to Submit Host as well? I.e. on Submit host in RSM configuration do I need to use OS file transfer and put UNC path to shared folder \\maincad\RSMStaging? Like below:

 

Remote solvers already using it. 

jcallery posted this 09 October 2019

Hi,

If you are trying to distribute across multiple machines your staging directory can't be a local drive "c:"

You will need to share that directory and in the staging directory setting use the unc path to that shared directory eg:

\\maincad\RSMStaging

 

Please be sure to set the RSMStaging share security to be open to all users and machines.

 

Thank you,

Jake

 

kolyan007 posted this 09 October 2019

Yesterday I was playing with Intel MPI as previously I've seen some load on solvers with it. The screenshot with Solve Process Settings and Advanced tab is below.

So I've tried with -mpi intelmpi argument and without. The result was the same, i.e. the solving process started on all machines, CPU load was 100% but only for a couple of minutes, then I got MPI_Abort error (full error message is also below).

Note: Regarding that Invalid working directory value= CRSMStaging/aokqqj0p.5k1 message it's weird as folder actually exists and accessible by solvers. Not sure why it has wrong slashes here.

Also, I do have NVidia Quadro GPU in each machine. Is it reasonable to enable GPU Acceleration to improve performance?

 

Error message (omitted):

send of 20 bytes failed.

Command Exit Code: 99

application called MPI_Abort(MPI_COMM_WORLD, 99) - process 0

[mpiexec@Maincad] ..\hydra\utils\sock\sock.c (420): write error (Unknown error)

[mpiexec@Maincad] ..\hydra\utils\launch\launch.c (121): shutdown failed, sock 648, error 10093

ClusterJobs Command Exit Code: 99

Saving exit code file: C:\RSMStaging\aokqqj0p.5k1\exitcode_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout

    Exit code file: C:\RSMStaging\aokqqj0p.5k1\exitcode_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout has been created.

Saving exit code file: C:\RSMStaging\aokqqj0p.5k1\exitcodeCommands_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout

    Exit code file: C:\RSMStaging\aokqqj0p.5k1\exitcodeCommands_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout has been created.

=======SOLVE.OUT FILE======

solve -->  *** FATAL ***

solve --> Attempt to run ANSYS in a distributed mode failed.

solve -->   The Distributed ANSYS process with MPI Rank ID =    4 is not responding.

solve -->   Please refer to the Distributed ANSYS Guide for detailed setup and configuration information.

ClusterJobs Exiting with code: 99

Individual Command Exit Codes are: [99]

 

 

 

Full error log:

RSM Version: 19.5.420.0, Build Date: 30/07/2019 57:06 am

RSM File Version: 19.5.0-beta.3+Branch.release-19.5.Sha.9c15e0a3e0a608e8efe8c568e494d2160788d025

RSM Library Version: 19.5.0.0

Job Name: Annulus_Thread_MAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)

    Type: Mechanical_ANSYS

    Client Directory: C:\TestProject\_ProjectScratch\Scr6531\

    Client Machine: Maincad

    Queue: Default [localhost, default]

    Template: Mechanical_ANSYSJob.xml

Cluster Configuration: localhost [localhost]

    Cluster Type: ARC

    Custom Keyword: blank

    Transfer Option: NativeOS

    Staging Directory: C:\RSMStaging

    Delete Staging Directory: True

    Local Scratch Directory: blank

    Platform: Windows

    Cluster Submit Options: blank

    Normal Inputs: [*.dat,file*.*,*.mac,thermal.build,commands.xml,SecInput.txt]

    Cancel Inputs: [file.abt,sec.interrupt]

    Excluded Inputs: [-]

    Normal Outputs: [*.xml,*.NR*,CAERepOutput.xml,cyclic_map.json,exit.topo,file*.dsub,file*.ldhi,file*.png,file*.r0*,file*.r1*,file*.r2*,file*.r3*,file*.r4*,file*.r5*,file*.r6*,file*.r7*,file*.r8*,file*.r9*,file*.rd*,file*.rst,file.BCS,file.ce,file.cm,file.cnd,file.cnm,file.DSP,file.err,file.gst,file.json,file.nd*,file.nlh,file.nr*,file.PCS,file.rdb,file.rfl,file.spm,file0.BCS,file0.ce,file0.cnd,file0.err,file0.gst,file0.nd*,file0.nlh,file0.nr*,file0.PCS,frequencies_*.out,input.x17,intermediate*.topo,Mode_mapping_*.txt,NotSupportedElems.dat,ObjectiveHistory.out,post.out,PostImage*.png,record.txt,solve*.out,topo.err,toput,vars.topo,SecDebugLog.txt,secStart.log,sec.validation.executed,sec.envvarvalidation.executed,sec.failure]

    Failure Outputs: [*.xml,*.NR*,CAERepOutput.xml,cyclic_map.json,exit.topo,file*.dsub,file*.ldhi,file*.png,file*.r0*,file*.r1*,file*.r2*,file*.r3*,file*.r4*,file*.r5*,file*.r6*,file*.r7*,file*.r8*,file*.r9*,file*.rd*,file*.rst,file.BCS,file.ce,file.cm,file.cnd,file.cnm,file.DSP,file.err,file.gst,file.json,file.nd*,file.nlh,file.nr*,file.PCS,file.rdb,file.rfl,file.spm,file0.BCS,file0.ce,file0.cnd,file0.err,file0.gst,file0.nd*,file0.nlh,file0.nr*,file0.PCS,frequencies_*.out,input.x17,intermediate*.topo,Mode_mapping_*.txt,NotSupportedElems.dat,ObjectiveHistory.out,post.out,PostImage*.png,record.txt,solve*.out,topo.err,toput,vars.topo,SecDebugLog.txt,sec.solverexitcode,secStart.log,sec.failure,sec.envvarvalidation.executed]

    Cancel Outputs: [file*.err,solve.out,secStart.log,SecDebugLog.txt]

    Excluded Outputs: [-]

    Inquire Files:

      normal: [*.xml,*.NR*,CAERepOutput.xml,cyclic_map.json,exit.topo,file*.dsub,file*.ldhi,file*.png,file*.r0*,file*.r1*,file*.r2*,file*.r3*,file*.r4*,file*.r5*,file*.r6*,file*.r7*,file*.r8*,file*.r9*,file*.rd*,file*.rst,file.BCS,file.ce,file.cm,file.cnd,file.cnm,file.DSP,file.err,file.gst,file.json,file.nd*,file.nlh,file.nr*,file.PCS,file.rdb,file.rfl,file.spm,file0.BCS,file0.ce,file0.cnd,file0.err,file0.gst,file0.nd*,file0.nlh,file0.nr*,file0.PCS,frequencies_*.out,input.x17,intermediate*.topo,Mode_mapping_*.txt,NotSupportedElems.dat,ObjectiveHistory.out,post.out,PostImage*.png,record.txt,solve*.out,topo.err,toput,vars.topo,SecDebugLog.txt,secStart.log,sec.validation.executed,sec.envvarvalidation.executed,sec.failure]

      cancel: [file*.err,solve.out,secStart.log,SecDebugLog.txt]

      failure: [*.xml,*.NR*,CAERepOutput.xml,cyclic_map.json,exit.topo,file*.dsub,file*.ldhi,file*.png,file*.r0*,file*.r1*,file*.r2*,file*.r3*,file*.r4*,file*.r5*,file*.r6*,file*.r7*,file*.r8*,file*.r9*,file*.rd*,file*.rst,file.BCS,file.ce,file.cm,file.cnd,file.cnm,file.DSP,file.err,file.gst,file.json,file.nd*,file.nlh,file.nr*,file.PCS,file.rdb,file.rfl,file.spm,file0.BCS,file0.ce,file0.cnd,file0.err,file0.gst,file0.nd*,file0.nlh,file0.nr*,file0.PCS,frequencies_*.out,input.x17,intermediate*.topo,Mode_mapping_*.txt,NotSupportedElems.dat,ObjectiveHistory.out,post.out,PostImage*.png,record.txt,solve*.out,topo.err,toput,vars.topo,SecDebugLog.txt,sec.solverexitcode,secStart.log,sec.failure,sec.envvarvalidation.executed]

      RemotePostInformation: [RemotePostInformation.txt]

      SolutionInformation: [solve.out,file.gst,file.nlh,file0.gst,file0.nlh,file.cnd]

      PostDuringSolve: [file.rcn,file.redm,file.rfl,file.rfrq,file.rmg,file.rdsp,file.rsx,file.rst,file.rth,solve.out,file.gst,file.nlh,file0.gst,file0.nlh,file.cnd]

      transcript: [solve.out,monitor.json]

Submission in progress...

Created storage directory C:\RSMStaging\aokqqj0p.5k1

Runtime Settings:

    Job Owner: MAINCAD\User

    Submit Time: Tuesday, 8 October 2019 11:40 pm

    Directory: C:\RSMStaging\aokqqj0p.5k1

Uploading file: C:\TestProject\_ProjectScratch\Scr6531\ds.dat

Uploading file: C:\TestProject\_ProjectScratch\Scr6531\remote.dat

Uploading file: C:\TestProject\_ProjectScratch\Scr6531\commands.xml

Uploading file: C:\TestProject\_ProjectScratch\Scr6531\SecInput.txt

39898.74 KB, .08 sec (498807.21 KB/sec)

Submission in progress...

JobType is: Mechanical_ANSYS

Final command platform: Windows

RSM_PYTHON_HOME=C:\Program Files\ANSYS Inc\v195\commonfiles\CPython\2_7_15\winx64\Release\python

RSM_HPC_JOBNAME=Mechanical

Distributed mode requested: True

RSM_HPC_DISTRIBUTED=TRUE

Running 1 commands

Job working directory: C:\RSMStaging\aokqqj0p.5k1

Number of CPU requested: 12

AWP_ROOT195=C:\Program Files\ANSYS Inc\v195

Checking queue default exists ...

JobId was parsed as: 4

Job submission was successful.

Job is running on hostname Maincad

Job user from this host: User

Starting directory: C:\RSMStaging\aokqqj0p.5k1

Reading control file C:\RSMStaging\aokqqj0p.5k1\control_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsm ....

Correct Cluster verified

Cluster Type: ARC

Underlying Cluster: ARC

    RSM_CLUSTER_TYPE = ARC

Compute Server is running on MAINCAD

Reading commands and arguments...

    Command 1: %AWP_ROOT195%\SEC\SolverExecutionController\runsec.bat, arguments: , redirectFile: None

Running from shared staging directory ...

    RSM_USE_LOCAL_SCRATCH = False

    RSM_LOCAL_SCRATCH_DIRECTORY =

    RSM_LOCAL_SCRATCH_PARTIAL_UNC_PATH =

Cluster Shared Directory: C:\RSMStaging\aokqqj0p.5k1

    RSM_SHARE_STAGING_DIRECTORY = C:\RSMStaging\aokqqj0p.5k1

Job file clean up: True

Use SSH on Linux cluster nodes: False

    RSM_USE_SSH_LINUX = False

LivelogFile: NOLIVELOGFILE

StdoutLiveLogFile: stdout_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.live

StderrLiveLogFile: stderr_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.live

Reading input files...

    *.dat

    file*.*

    *.mac

    thermal.build

    commands.xml

    SecInput.txt

Reading cancel files...

    file.abt

    sec.interrupt

Reading output files...

    *.xml

    *.NR*

    CAERepOutput.xml

    cyclic_map.json

    exit.topo

    file*.dsub

    file*.ldhi

    file*.png

    file*.r0*

    file*.r1*

    file*.r2*

    file*.r3*

    file*.r4*

    file*.r5*

    file*.r6*

    file*.r7*

    file*.r8*

    file*.r9*

    file*.rd*

    file*.rst

    file.BCS

    file.ce

    file.cm

    file.cnd

    file.cnm

    file.DSP

    file.err

    file.gst

    file.json

    file.nd*

    file.nlh

    file.nr*

    file.PCS

    file.rdb

    file.rfl

    file.spm

    file0.BCS

    file0.ce

    file0.cnd

    file0.err

    file0.gst

    file0.nd*

    file0.nlh

    file0.nr*

    file0.PCS

    frequencies_*.out

    input.x17

    intermediate*.topo

    Mode_mapping_*.txt

    NotSupportedElems.dat

    ObjectiveHistory.out

    post.out

    PostImage*.png

    record.txt

    solve*.out

    topo.err

    toput

    vars.topo

    SecDebugLog.txt

    secStart.log

    sec.validation.executed

    sec.envvarvalidation.executed

    sec.failure

    *.xml

    *.NR*

    CAERepOutput.xml

    cyclic_map.json

    exit.topo

    file*.dsub

    file*.ldhi

    file*.png

    file*.r0*

    file*.r1*

    file*.r2*

    file*.r3*

    file*.r4*

    file*.r5*

    file*.r6*

    file*.r7*

    file*.r8*

    file*.r9*

    file*.rd*

    file*.rst

    file.BCS

    file.ce

    file.cm

    file.cnd

    file.cnm

    file.DSP

    file.err

    file.gst

    file.json

    file.nd*

    file.nlh

    file.nr*

    file.PCS

    file.rdb

    file.rfl

    file.spm

    file0.BCS

    file0.ce

    file0.cnd

    file0.err

    file0.gst

    file0.nd*

    file0.nlh

    file0.nr*

    file0.PCS

    frequencies_*.out

    input.x17

    intermediate*.topo

    Mode_mapping_*.txt

    NotSupportedElems.dat

    ObjectiveHistory.out

    post.out

    PostImage*.png

    record.txt

    solve*.out

    topo.err

    toput

    vars.topo

    SecDebugLog.txt

    sec.solverexitcode

    secStart.log

    sec.failure

    sec.envvarvalidation.executed

Reading exclude files...

    stdout_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout

    stderr_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout

    control_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsm

    hosts.dat

    exitcode_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout

    exitcodeCommands_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout

    stdout_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.live

    stderr_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.live

    ClusterJobCustomization.xml

    ClusterJobs.py

    clusterjob_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.sh

    clusterjob_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.bat

    inquire.request

    inquire.confirm

    request.upload.rsm

    request.download.rsm

    wait.download.rsm

    scratch.job.rsm

    volatile.job.rsm

    restart.xml

    cancel_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout

    liveLogLastPositions_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsm

    stdout_782e78b5-2c00-45fa-b7ac-6976aa49c2cf_kill.rsmout

    stderr_782e78b5-2c00-45fa-b7ac-6976aa49c2cf_kill.rsmout

    sec.interrupt

    stdout_782e78b5-2c00-45fa-b7ac-6976aa49c2cf_*.rsmout

    stderr_782e78b5-2c00-45fa-b7ac-6976aa49c2cf_*.rsmout

    stdout_task_*.live

    stderr_task_*.live

    control_task_*.rsm

    stdout_task_*.rsmout

    stderr_task_*.rsmout

    exitcode_task_*.rsmout

    exitcodeCommands_task_*.rsmout

    file.abt

Reading environment variables...

    RSM_IRON_PYTHON_HOME = C:\Program Files\ANSYS Inc\v195\commonfiles\IronPython

    RSM_TASK_WORKING_DIRECTORY = C:\RSMStaging\aokqqj0p.5k1

    RSM_USE_SSH_LINUX = False

    RSM_QUEUE_NAME = default

    RSM_CONFIGUREDQUEUE_NAME = Default

    RSM_COMPUTE_SERVER_MACHINE_NAME = Maincad

    RSM_HPC_JOBNAME = Mechanical

    RSM_HPC_DISPLAYNAME = Annulus_Thread_MAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)

    RSM_HPC_CORES = 12

    RSM_HPC_DISTRIBUTED = TRUE

    RSM_HPC_NODE_EXCLUSIVE = FALSE

    RSM_HPC_QUEUE = default

    RSM_HPC_USER = MAINCAD\User

    RSM_HPC_WORKDIR = C:\RSMStaging\aokqqj0p.5k1

    RSM_HPC_JOBTYPE = Mechanical_ANSYS

    RSM_HPC_ANSYS_LOCAL_INSTALL_DIRECTORY = C:\Program Files\ANSYS Inc\v195

    RSM_HPC_VERSION = 195

    RSM_HPC_STAGING = C:\RSMStaging\aokqqj0p.5k1

    RSM_HPC_LOCAL_PLATFORM = Windows

    RSM_HPC_CLUSTER_TARGET_PLATFORM = Windows

    RSM_HPC_STDOUTFILE = stdout_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout

    RSM_HPC_STDERRFILE = stderr_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout

    RSM_HPC_STDOUTLIVE = stdout_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.live

    RSM_HPC_STDERRLIVE = stderr_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.live

    RSM_HPC_SCRIPTS_DIRECTORY_LOCAL = C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts

    RSM_HPC_SCRIPTS_DIRECTORY = C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts

    RSM_HPC_SUBMITHOST = localhost

    RSM_HPC_STORAGEID = <JobId>    <id>a7ab7b67-dc3d-44cb-a665-813ffa216eee</id>    <nativeId>Mechanical=LocalOS#localhost$C:\RSMStaging\aokqqj0p.5k1</nativeId>    <timestamp>Tuesday, October 08, 2019 10:40:05.011 AM</timestamp>    <fullyDefined>True</fullyDefined></JobId>

    RSM_HPC_PLATFORMSTORAGEID = C:\RSMStaging\aokqqj0p.5k1

    RSM_HPC_NATIVEOPTIONS =

    ARC_ROOT = C:\Program Files\ANSYS Inc\v195\RSM\Config\scripts\..\..\ARC

    RSM_HPC_KEYWORD = ARC

    RSM_PYTHON_LOCALE = en-us

Reading AWP_ROOT environment variable name ...

    AWP_ROOT environment variable name is: AWP_ROOT195

Reading Low Disk Space Warning Limit ...

    Low disk space warning threshold set at: 2.0GiB

Reading File identifier ...

    File identifier found as: 782e78b5-2c00-45fa-b7ac-6976aa49c2cf

Done reading control file.

RSM_AWP_ROOT_NAME = AWP_ROOT195

AWP_ROOT195 install directory: C:\Program Files\ANSYS Inc\v195

RSM_MACHINES = maincad:4:cluster01:4:cluster02:4

Number of nodes assigned for current job = 3

Machine list: ['maincad', 'cluster01', 'cluster02']

Checking DisableUNCCheck ...

Unable to read registry for HKEY_CURRENT_USER\Software\Microsoft\Command Processor

Ignore verifying DisableUNCCheck, you may check it manually if not already done so.

Start running job commands ...

Running on machine : Maincad

Current Directory: C:\RSMStaging\aokqqj0p.5k1

Running command: C:\Program Files\ANSYS Inc\v195\SEC\SolverExecutionController\runsec.bat

Redirecting output to  None

Final command arg list : ['C:\\Program Files\\ANSYS Inc\\v195\\SEC\\SolverExecutionController\\runsec.bat']

Running Process

Running Solver : C:\Program Files\ANSYS Inc\v195\ansys\bin\winx64\ANSYS195.exe -b nolist -s noread -acc nvidia -na 1 -p ansys -mpi intelmpi -i remote.dat -o solve.out -dis -machines maincad:4:cluster01:4:cluster02:4 -dir "CRSMStaging/aokqqj0p.5k1"

 *** The AWP_ROOT195 environment variable is set to: C:\Program Files\ANSYS Inc\v195

 *** The AWP_LOCALE195 environment variable is set to: en-us

 *** The ANSYS195_DIR environment variable is set to: C:\Program Files\ANSYS Inc\v195\ANSYS

 *** The ANSYS_SYSDIR environment variable is set to: winx64

 *** The ANSYS_SYSDIR32 environment variable is set to: intel

 *** The CADOE_DOCDIR195 environment variable is set to: C:\Program Files\ANSYS Inc\v195\CommonFiles\help\en-us\solviewer

 *** The CADOE_LIBDIR195 environment variable is set to: C:\Program Files\ANSYS Inc\v195\CommonFiles\Language\en-us

 *** The LSTC_LICENSE environment variable is set to: ANSYS

 *** The P_SCHEMA environment variable is set to: C:\Program Files\ANSYS Inc\v195\AISOL\CADIntegration\Parasolid\PSchema

 *** The TEMP environment variable is set to: C:\Users\User\AppData\Local\Temp

 *** FATAL ***

  Invalid working directory value= CRSMStaging/aokqqj0p.5k1

  (specified working directory does not exist)

 *** NOTE ***

  USAGE: C:\Program Files\ANSYS Inc\v195\ANSYS\bin\winx64\ANSYS.EXE

                     [-d device name] [-j job name]

                     [-b list|nolist] [-m scratch memory(mb)]

                     [-s read|noread] [-g] [-db database(mb)]

                     [-p product] [-l language]

                     [-dyn] [-np #] [-mfm]

                     [-dvt] [-dis] [-machines list]

                     [-i inputfile] [-o outputfile]

                     [-ser port] [-scport port]

                     [-scname couplingname] [-schost hostname]

                     [-smp] [-mpi intelmpi|ibmmpi|msmpi]

                     [-dir working_directory ]

 *** FATAL ***

  Invalid working directory value= CRSMStaging/aokqqj0p.5k1

  (specified working directory does not exist)

 *** NOTE ***

  USAGE: C:\Program Files\ANSYS Inc\v195\ANSYS\bin\winx64\ANSYS.EXE

                     [-d device name] [-j job name]

                     [-b list|nolist] [-m scratch memory(mb)]

                     [-s read|noread] [-g] [-db database(mb)]

                     [-p product] [-l language]

                     [-dyn] [-np #] [-mfm]

                     [-dvt] [-dis] [-machines list]

                     [-i inputfile] [-o outputfile]

                     [-ser port] [-scport port]

                     [-scname couplingname] [-schost hostname]

                     [-smp] [-mpi intelmpi|ibmmpi|msmpi]

                     [-dir working_directory ]

                     [-acc nvidia] [-na #]

 *** FATAL ***

  Invalid working directory value= CRSMStaging/aokqqj0p.5k1

  (specified working directory does not exist)

 *** NOTE ***

  USAGE: C:\Program Files\ANSYS Inc\v195\ANSYS\bin\winx64\ANSYS.EXE

                     [-d device name] [-j job name]

                     [-b list|nolist] [-m scratch memory(mb)]

                     [-s read|noread] [-g] [-db database(mb)]

                     [-p product] [-l language]

                     [-dyn] [-np #] [-mfm]

                     [-dvt] [-dis] [-machines list]

                     [-i inputfile] [-o outputfile]

                     [-ser port] [-scport port]

                     [-scname couplingname] [-schost hostname]

                     [-smp] [-mpi intelmpi|ibmmpi|msmpi]

                     [-dir working_directory ]

                     [-acc nvidia] [-na #]

 *** FATAL ***

  Invalid working directory value= CRSMStaging/aokqqj0p.5k1

  (specified working directory does not exist)

 *** NOTE ***

  USAGE: C:\Program Files\ANSYS Inc\v195\ANSYS\bin\winx64\ANSYS.EXE

                     [-d device name] [-j job name]

                     [-b list|nolist] [-m scratch memory(mb)]

                     [-s read|noread] [-g] [-db database(mb)]

                     [-p product] [-l language]

                     [-dyn] [-np #] [-mfm]

                     [-dvt] [-dis] [-machines list]

                     [-i inputfile] [-o outputfile]

                     [-ser port] [-scport port]

                     [-scname couplingname] [-schost hostname]

                     [-smp] [-mpi intelmpi|ibmmpi|msmpi]

                     [-dir working_directory ]

                     [-acc nvidia] [-na #]

                     [-acc nvidia] [-na #]

 *** FATAL ***

  Invalid working directory value= CRSMStaging/aokqqj0p.5k1

  (specified working directory does not exist)

 *** NOTE ***

  USAGE: C:\Program Files\ANSYS Inc\v195\ANSYS\bin\winx64\ANSYS.EXE

                     [-d device name] [-j job name]

                     [-b list|nolist] [-m scratch memory(mb)]

                     [-s read|noread] [-g] [-db database(mb)]

                     [-p product] [-l language]

                     [-dyn] [-np #] [-mfm]

                     [-dvt] [-dis] [-machines list]

                     [-i inputfile] [-o outputfile]

                     [-ser port] [-scport port]

                     [-scname couplingname] [-schost hostname]

                     [-smp] [-mpi intelmpi|ibmmpi|msmpi]

                     [-dir working_directory ]

                     [-acc nvidia] [-na #]

 *** FATAL ***

  Invalid working directory value= CRSMStaging/aokqqj0p.5k1

  (specified working directory does not exist)

 *** NOTE ***

  USAGE: C:\Program Files\ANSYS Inc\v195\ANSYS\bin\winx64\ANSYS.EXE

                     [-d device name] [-j job name]

                     [-b list|nolist] [-m scratch memory(mb)]

                     [-s read|noread] [-g] [-db database(mb)]

                     [-p product] [-l language]

                     [-dyn] [-np #] [-mfm]

                     [-dvt] [-dis] [-machines list]

                     [-i inputfile] [-o outputfile]

                     [-ser port] [-scport port]

                     [-scname couplingname] [-schost hostname]

                     [-smp] [-mpi intelmpi|ibmmpi|msmpi]

                     [-dir working_directory ]

                     [-acc nvidia] [-na #]

 *** FATAL ***

  Invalid working directory value= CRSMStaging/aokqqj0p.5k1

  (specified working directory does not exist)

 *** NOTE ***

  USAGE: C:\Program Files\ANSYS Inc\v195\ANSYS\bin\winx64\ANSYS.EXE

                     [-d device name] [-j job name]

                     [-b list|nolist] [-m scratch memory(mb)]

                     [-s read|noread] [-g] [-db database(mb)]

                     [-p product] [-l language]

                     [-dyn] [-np #] [-mfm]

                     [-dvt] [-dis] [-machines list]

                     [-i inputfile] [-o outputfile]

                     [-ser port] [-scport port]

                     [-scname couplingname] [-schost hostname]

                     [-smp] [-mpi intelmpi|ibmmpi|msmpi]

                     [-dir working_directory ]

                     [-acc nvidia] [-na #]

 *** FATAL ***

  Invalid working directory value= CRSMStaging/aokqqj0p.5k1

  (specified working directory does not exist)

 *** NOTE ***

  USAGE: C:\Program Files\ANSYS Inc\v195\ANSYS\bin\winx64\ANSYS.EXE

                     [-d device name] [-j job name]

                     [-b list|nolist] [-m scratch memory(mb)]

                     [-s read|noread] [-g] [-db database(mb)]

                     [-p product] [-l language]

                     [-dyn] [-np #] [-mfm]

                     [-dvt] [-dis] [-machines list]

                     [-i inputfile] [-o outputfile]

                     [-ser port] [-scport port]

                     [-scname couplingname] [-schost hostname]

                     [-smp] [-mpi intelmpi|ibmmpi|msmpi]

                     [-dir working_directory ]

                     [-acc nvidia] [-na #]

send of 20 bytes failed.

Command Exit Code: 99

application called MPI_Abort(MPI_COMM_WORLD, 99) - process 0

[mpiexec@Maincad] ..\hydra\utils\sock\sock.c (420): write error (Unknown error)

[mpiexec@Maincad] ..\hydra\utils\launch\launch.c (121): shutdown failed, sock 648, error 10093

ClusterJobs Command Exit Code: 99

Saving exit code file: C:\RSMStaging\aokqqj0p.5k1\exitcode_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout

    Exit code file: C:\RSMStaging\aokqqj0p.5k1\exitcode_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout has been created.

Saving exit code file: C:\RSMStaging\aokqqj0p.5k1\exitcodeCommands_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout

    Exit code file: C:\RSMStaging\aokqqj0p.5k1\exitcodeCommands_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout has been created.

=======SOLVE.OUT FILE======

solve -->  *** FATAL ***

solve --> Attempt to run ANSYS in a distributed mode failed.

solve -->   The Distributed ANSYS process with MPI Rank ID =    4 is not responding.

solve -->   Please refer to the Distributed ANSYS Guide for detailed setup and configuration information.

ClusterJobs Exiting with code: 99

Individual Command Exit Codes are: [99]

 

 

jcallery posted this 08 October 2019

Please post a screenshot of your Solution properties if submitting from workbench or post the screenshot of your Solve Process Settings and the advanced tab for the solve process setting you are using.

 

Thank you,

Jake

kolyan007 posted this 08 October 2019

Only Submit host has some activity with ANSYS, solvers don't show it. Weird.

This screenshot from Submit host:

tsiriaks posted this 07 October 2019

This seems good (and by the way, the Service Mode for IBM MPI is the correct choice) .

If you open up Task Manager on solving machines do you see any ANSYS.exe or ANSYS195.exe ?

kolyan007 posted this 07 October 2019

Right, so IBM MPI is installed on all machines as Service Mode, hope it's correct set. Also -mpi ibmmpi as argument also added. Telnet to TCP 8636 from Submit Host to solvers is ok.

Now solving working, but I don't see any CPU load on my solvers. If there anything else to check?

 

Start running job commands ...

Running on machine : Maincad

Current Directory: c:\RSMStaging\ofwkpry5.3rq

Running command: C:\Program Files\ANSYS Inc\v195\SEC\SolverExecutionController\runsec.bat

Redirecting output to  None

Final command arg list : ['C:\\Program Files\\ANSYS Inc\\v195\\SEC\\SolverExecutionController\\runsec.bat']

Running Process

Running Solver : C:\Program Files\ANSYS Inc\v195\ansys\bin\winx64\ANSYS195.exe -b nolist -s noread -p ansys -mpi ibmmpi -i remote.dat -o solve.out -dis -machines maincad:1:cluster01:1:cluster02:1 -dir "cRSMStaging/ofwkpry5.3rq"

WARNING: No cached password or password provided.

         use '-pass' or '-cache' to provide password

 *** The AWP_ROOT195 environment variable is set to: C:\Program Files\ANSYS Inc\v195

 *** The AWP_LOCALE195 environment variable is set to: en-us

 *** The ANSYS195_DIR environment variable is set to: C:\Program Files\ANSYS Inc\v195\ANSYS

 *** The ANSYS_SYSDIR environment variable is set to: winx64

 *** The ANSYS_SYSDIR32 environment variable is set to: intel

 *** The CADOE_DOCDIR195 environment variable is set to: C:\Program Files\ANSYS Inc\v195\CommonFiles\help\en-us\solviewer

 *** The CADOE_LIBDIR195 environment variable is set to: C:\Program Files\ANSYS Inc\v195\CommonFiles\Language\en-us

 *** The LSTC_LICENSE environment variable is set to: ANSYS

 *** The P_SCHEMA environment variable is set to: C:\Program Files\ANSYS Inc\v195\AISOL\CADIntegration\Parasolid\PSchema

 *** The TEMP environment variable is set to: C:\Users\User\AppData\Local\Temp

 

kolyan007 posted this 07 October 2019

What arguments should I use if I will be using Intel MPI? (once MPI installed on all machines)

What installation set of IBM MPI would be the best for Windows 10? (Service Mode, Service Only or HPC mode)

kolyan007 posted this 07 October 2019

Thanks for advise. I've installed MPI services only on Submit host. I will add it to remote solvers and add these CMD arguments. 

jcallery posted this 07 October 2019

Looks like something is blocking the IntelMPI processes.

Firewall / User Account Control / Antivirus / etc...

You could try IBM MPI instead.

First make sure IBM/Platform MPI is installed on all machines.

Then In Mechanical go to Solve Process Settings -> Select your config -> Advanced

In the Additional Command Line Arguments add:

-mpi ibmmpi

 

Then try it again.

 

Thank you,

Jake

kolyan007 posted this 06 October 2019

Followed ANSYS RSM user guide to finalize my cluster setup.

 

Got 3 nodes under RSM Cluster Monitoring and tests were fine, but there is an error when I tried to solve my project. Maincad is my Submit Host+solver, Cluster02 is only solver. Please advise what could be wrong?

  

kolyan007 posted this 05 October 2019

Just checked RSM Cluster Load Monitoring on HEAD node, it shows only 1 node, not 3. I've manually created another queue and added another nodes to it, but it doesn't help.

My queues and RSM Cluster output on HEAD node is below:

 

tsiriaks posted this 03 October 2019

sounds good, please keep us posted

Thanks,

Win

tsiriaks posted this 02 October 2019

Continued

 

On client machines. Note All info here is the same on any client machine. The Submit Host is the dedicated node above. Do not use local machine information.

Launch RSM Configuration GUI

Once you are in the GUI, click the plus sign on the top left then fill out name or its IP address of the Submit Host machine and OS.

Once, this is done, click “Apply”

Go to “File Management” tab , Select "Operating System File Transfer" , Put in the share path to the RSMStaging directory you shared earlier (again, this is the same UNC path that you setup to share above, do not use local machine information)

Once, this is done, click “Apply”

Then, Go to “Queues” tab , click “Import/Refresh Cluster Queues” , then specify your login username and password. This will bring up all the queues. You can enable and disable any queue that you like.

Then make sure that port 9195 is open between the client and the ‘submit host’ machines.

jcallery posted this 02 October 2019

Hi Nick,

 

There seems to be a number of different issues to look at here.

First, please uninstall the ARC Master and RSM Launcher services from the two machines that are NOT the head node.

You can do this from the command line by doing the following:

Start -> Type cmd -> Right click on Command Prompt and select Run As administrator

At the prompt type:

cd /d "c:\program files\ansys inc\v195\RSM\bin"

ansunconfigrsm -launcher

cd /d "c:\program files\ansys inc\v195\RSM\ARC\tools\winx64"

uninstallservice -arcmaster

 

This should leave the ARC Node service running on MainCad,Cluster01,Cluster02

This should leave the ARC Master and Launcher service running on MainCad only.

 

Once that is done, go to MainCad and run the admin command prompt as state above, then type:

cd /c "c:\program files\ansys inc\v195\RSM\ARC\tools\winx64"

arcnodes

arcqueues

Then please paste a screenshot of that.

 

Thank you,

Jake

 

 

 

tsiriaks posted this 02 October 2019

ok, so you are using ANSYS own light-weight scheduler (ARC).

I normally use commands to set this, so I'm not familiar with settings on the ARC Config GUI but I've asked a colleague to help check it.

However, I see a lot of mis-configurations.

Essentially, this is what you need to do to properly setup RSM-ARC

 

Create share directory

Create a directory on a machine that you would like to use as the staging directory.

 

For this example, I will use e:\RSMStaging

Now share that directory out to all solving machines and 'submit host' so that anyone can read and write to it.

---------

Right click on RSMStaging and select Properties Select Sharing Tab

Click on Share...

 

Type in:

Everyone

And click Add

 

Type in:

Domain Computers

Click Add

 

Type in:

Domain Users

Click Add

 

Give each of the users Read/Write access

Then click "Share"

Then click Done

 

 

On 'submit host' machine (This is a dedicated node. Do not install this on all nodes)

 

This is the machine that receives requests from clients, then queues and distributes jobs to solve on solving machines. This machine itself can also be a solving machine.

 

Two components are required here: 

 

1. RSM Launcher service, which deals with the communications between client machine and this machine

 

2. ARC Master service is one of the two parts of the ARC job scheduler, a light-weight job scheduler that ANSYS provides. This part deals with the communications between RSM Launcher and solving machine(s) , essentially, queueing and distributing jobs to solving machine(s).

 

 

 

 

 

On solving machine(s)

 

Install ARC Node service, which is used for communicating with the ARC Master service.

 

 

 

 

 

 

kolyan007 posted this 02 October 2019

Thanks for your reply. I was thinking there is some incompatibility between my 3 machine cluster and R2, so I did reinstall OS on master machine (maincad) that using to send tasks to slaves in cluster, install R3 on it and install R3 on slaves, then replicate settings.

I don't have my own scheduler. All machines connecting to each other.

There are a screenshots with my config below.

ARC configuration on master

ARC configuration on masterARC configuration on masterARC configuration on master

ARC configuration on masterARC configuration on master

Note: I'm not sure why, but Service Management running by cluster02\user. Not sure how to change to default.

RSM config on master:

RSM configuration on master

RSM configuration on masterRSM configuration on master

Somehow Queues refresh fails.

This is after I deleted credentials for cluster01

RSM configuration on master

RSM config for cluster02

RSM configuration on master

RSM configuration on masterRSM configuration on master

 

And RSM config for localhost

RSM configuration on master

RSM configuration on masterRSM configuration on master

These 3 services running on each machine in cluster:

Master:

Services on master

Cluster01

Services on cluster01

Cluster02

Services on cluster02

My Solve Process settings:

Solve settings

Solve in mechanical

 

Also I've tested telnet to port 9195 and SMB in Windows, there is no issues from OS perspective. All machines using same credentials.

 

Additionally I've found that if I run: arcconfig node modify %COMPUTERNAME% -mn maincad                  so test in RSM will go in schedule mode, but if I replace my master node with %COMPUTERNAME%, a test will go through fine. What options is correct?

Cluster01 port 9195 listening

 

Cluster02 port 9195 listening

 

 

tsiriaks posted this 01 October 2019

Thanks for the screenshot Peter.

So, this is Mechanical + ANSYS RSM.

I'm gonna need much more information to proceed. Note: That folder should be automatically created by the solver.

When you said 'cluster' , do you mean it has job scheduler or it's just 3 machines with no job scheduler connecting to each other ? If you have your own scheduler, what's the name of it ? 

How do you submit the jobs ? Please show screenshots of the workflow and setup in both Workbench and RSM Configuration GUI's

Post screenshot of the top part of RSM Job Report.

Thanks,

Win

kolyan007 posted this 01 October 2019

Thanks Peter, good spotting. That folder \ScrCA9A is missing under \_ProjectScratch. How I can find why Mechanical trying to access it? Could it be because of some references in projects?

peteroznewman posted this 30 September 2019

Win, it looks like a directory error.

tsiriaks posted this 30 September 2019

Hi Nick,

Sorry, ANSYS employees are not allowed to download file attachments. Could you post this as an inline text or post screenshots inline ?

Are you using ANSYS Student (free) version ?

Is this Mechanical, Fluids, or Electronics product ?

Thanks,

Win

Close