2. COMSOL Multiphysicsの使用方法

2.1. COMSOL Multiphysicsのコマンドライン実行

2.1.1. インタラクティブ実行

ログイン方法を参考にログインノードにログイン後、インタラクティブノードを利用したX転送を参考にノードをX転送付きで確保して下さい。 以下以降の例では、全て計算ノードにログインした状態で行います。

2.1.1.1. CUI実行

プラズマモジュールのアルゴンガス充填サンプルを用いたインタラクティブ処理を以下に示します。
計算ノードにログインし、実行してください。
以下はあくまでもコマンドサンプルです。実際の計算には入力ファイルが必要となります。

$ cd <利用したいディレクトリ>
$ module load comsol/53
$ comsol batch -inputfile argon_dbd_1d.mph

28CPUを利用した並列計算
*mphファイルの構成によっては並列計算を行いません。

$ cd <利用したいディレクトリ>
$ module load comsol/53
$ comsol batch -np 28 -inputfile argon_dbd_1d.mph

ヘルプコマンドの内容
comsol --helpコマンドでコマンドオプションの確認ができます。 バージョンによって内容が異なる場合がありますので、利用されるバージョンに合わせてオプションの詳細については適宜確認してください。
53aアップデート3のヘルプコマンド例

$ module load comsol/53a_u3
$ comsol --help
Usage: comsol [options] [target] [target arguments]

COMSOL commands:

   comsol                       Run COMSOL Multiphysics Desktop
   comsol batch                 Run a COMSOL job
   comsol compile               Compile a COMSOL Model java file
   comsol mphclient             Run COMSOL Multiphysics Desktop client
   comsol mphserver             Run COMSOL Multiphysics Server
   comsol mphserver matlab      Run MATLAB with COMSOL Multiphysics Server
   comsol hydra                 Run Hydra commands       
   comsol mpd                   Run MPD commands       

COMSOL options:

   -3drend <{ogl}|sw>           3D renderer: OpenGL or software rendering
   -applicationsroot <path>     Specify custom path to the COMSOL Application
                                  Libraries root directory
   -autosave <{on}|off>         Control saving of recovery files
   -blas <{auto}|mkl|acml|      BLAS library to use
           path>
   -blaspath <path>             Set path to BLAS library
   -c <path>                    Path to license file
   -ckl                         Use class-kit license
   -comsolinifile <path>        Path to .ini-file to use when launching
                                COMSOL
   -configuration <path>        Path to directory for storing the state for
                                  the GUI between sessions, and for performing
                                  different caching tasks
   -data <path>                 Path to data directory
   -docroot <path>              Specify custom path to the COMSOL documentation
                                  root directory
   -forcecomsolgcc              Force load of GCC libraries shipped with
                                COMSOL
   -forcegcc                    Force load of GCC libraries
   -h, -help                    Show this help message
   -keeplicenses <on|{off}>     Keep checked out licenses throughout session
   -mpmode <throughput|         Set multiprocessor mode
             turnaround|owner>
   -np <no. of cores|{auto}>    Set number of cores
   -numafirst <numa number>     Set first NUMA node to bind process to
   -numasets <no. of sets>      Set number of NUMA nodes to optimize
                                processor usage
   -prefsdir <path>             Path to preference directory
   -recoverydir <path>          Path to recovery directories
   -tmpdir <path>               Path to temporary directory
   -v, -version                 Show version information

Cluster options:

   -f <path>                    Set path to hostfile
   -mpd                         Use MPD instead of Hydra launcher in MPI
   -mpi <{auto}|mpich2|intel|   MPI library to use. path requires
          wccs2003|whpc2008|    environment variable COMSOL_MPI_PATH
          user|path>            to be set
   -mpiarg <arg>                MPI cluster-specific command arguments
   -mpibootstrap <{ssh}|rsh|    Set bootstrap server (for Hydra)
                   fork|slurm|
                   ll|lsf|
                   sge|jmi>
   -mpibootstrapexec <path>     Set executable used by bootstrap server
   -mpidebug <debug level>      Set the MPI debug level
   -mpienablex                  Enable Xlib forwarding
   -mpifabrics fabric1:fabric2  Select network fabrics where
                                fabric1 is one of <shm,dapl,tcp,tmi,ofa>
                                and fabric2 is one of <dapl,tcp,tmi,ofa>
   -mpihosts <list of hosts>    Comma separated list of hosts
   -mpirmk <pbs>                Select resource management kernel
   -mpitranslationcache <{on}|  Enable translation cache for RDMA
                          off>
   -mpipath <file>              MPI shared library file
   -mpiroot <path>              Set path to root of MPI library installation
   -mpirsh <path to command>    Set path to RSH or SSH command (for MPD)
   -nn <no. of nodes>           Number of nodes
   -nnhost <no. of nodes>       Number of nodes on each host
   -scalapack <{auto}|mkl|      ScaLaPACK library to use. path requires
                user|path>      environment variable COMSOL_SCALAPACK_PATH
                                to be set
   -scalapackpath <file>        Set path to ScaLaPACK library

Comsol options:

   -open <filename>             The input file name
   -edit <filename>             The input file name to edit
   -run  <filename>             The input file name to run

Example:

   comsol -open <filename>

-tmpdir オプション付きで起動することで、COMSOL Multiphysics ソフトウェアは指定ディレクトリをテンポラリファイル保存ディレクトリとして使用します。 また、環境変数 COMSOL_TMPDIRを使用することもできます。 COMSOL Multiphysics が環境設定ファイルを格納するディレクトリを指定するには、-presdirオプションを使用します。

2.1.1.2. GUI実行

qrshで接続したノードから直接X転送を行う場合は、下記の手順にて接続ください。 なお、f_nodeのみが対象となります。 f_node以外を利用する場合は、SSHが利用できないため、マルチノードでの実行はできません。
コマンド実行例
例では1ノードを2時間接続で、割り当てノードとしてr0i0n0が割り当てられた場合を想定しております。
割り当てノードはコマンド実行時に空いているノードですので、明示的にノードを指定することはできません。

#qrshの実行
$ qrsh -g [TSUBAME3グループ] -l f_node=1 -l h_rt=2:00:00
Thu Sep 21 08:17:19 JST 2017
r0i0n0:~> . /etc/profile.d/modules.sh
r0i0n0:~> module load comsol/53
r0i0n0:~> comsol


comsolスタートアップ画面

GUIでのマルチノード計算を行う場合は以下の例のように実施することで計算可能です。 以下の例では GSICGROUP に所属している GSICUSER が f_node を4ノード、3時間利用する場合の例でr4i7n3, r6i3n5, r2i4n0 および r2i3n4 がNode0から3にそれぞれアサインされています。 実際の投入は所属グループを指定してください。
GUI並列実行の場合はライブラリの問題があるため、Run Application機能による計算が利用できませんのでcomputeによる計算を実行ください。

login1:~> qrsh -l f_node=4,h_rt=3:: -g GSICGROUP
r4i7n3:~> . /etc/profile.d/modules.sh
r4i7n3:~> module load comsol/53a_u3
r4i7n3:~> comsol -mpibootstrap ssh -mpihosts `awk '{ print $1 }' $PE_HOSTFILE |xargs | sed -e 's/ /,/g'` -nn `cat $PE_HOSTFILE |  wc -l`
(r4i7n3:0)
(r6i3n5:1)
(r2i4n0:2)
(r2i3n4:3)
Node 0 is running on host: r4i7n3
Node 0 has address: r4i7n3
Node 1 is running on host: r6i3n5
Node 1 has address: r6i3n5
Node 2 is running on host: r2i4n0
Node 2 has address: r2i4n0
Node 3 is running on host: r2i3n4
Node 3 has address: r2i3n4

各ノードでの実行確認の例

以下はaluminum_extrusion_fsi.mphをGUIで実行した例となります。 Node0のr4i7n3でmpiexec.hydra が実行され、comsolclusterが全ノードで実行されていることが確認できます。 topコマンド等でも確認は可能です。

アサインされた全ノードでecho $HOSTNAME; date; ps aux | grep comsollauncherコマンドを実行した結果

r4i7n3
Tue Jul 17 14:43:38 JST 2018
GSICUSER 20394  0.0  0.0  17788  3136 pts/0    S+   14:30   0:00 /apps/t3/sles12sp2/isv/comsol/comsol53a_u3/multiphysics/ext/impi/glnxa64/bin64/mpiexec.hydra -hosts r4i7n3 r6i3n5 r2i4n0 r2i3n4 -bootstrap ssh -print-rank-map -env LD_PRELOAD /apps/t3/sles12sp2/isv/comsol/comsol53a_u3/multiphysics/java/glnxa64/jre/lib/amd64/libjsig.so:/apps/t3/sles12sp2/isv/comsol/comsol53a_u3/multiphysics/ext/impi/glnxa64/lib64/libmpi.so -n 4 -envall /apps/t3/sles12sp2/isv/comsol/comsol53a_u3/multiphysics/bin/glnxa64/comsollauncher --launcher.ini /apps/t3/sles12sp2/isv/comsol/comsol53a_u3/multiphysics/bin/glnxa64/comsolcluster.ini
GSICUSER 20402 1680  1.5 16195576 4127184 pts/0 Sl  14:30 213:41 /apps/t3/sles12sp2/isv/comsol/comsol53a_u3/multiphysics/bin/glnxa64/comsollauncher --launcher.ini /apps/t3/sles12sp2/isv/comsol/comsol53a_u3/multiphysics/bin/glnxa64/comsolcluster.ini


r6i3n5
Tue Jul 17 14:43:38 JST 2018
GSICUSER 15069 1744  1.3 11840084 3600304 ?    Sl   14:30 221:39 /apps/t3/sles12sp2/isv/comsol/comsol53a_u3/multiphysics/bin/glnxa64/comsollauncher --launcher.ini /apps/t3/sles12sp2/isv/comsol/comsol53a_u3/multiphysics/bin/glnxa64/comsolcluster.ini

r2i4n0
Tue Jul 17 14:43:38 JST 2018
GSICUSER 10435 1743  1.5 11868540 4152340 ?    Sl   14:30 221:35 /apps/t3/sles12sp2/isv/comsol/comsol53a_u3/multiphysics/bin/glnxa64/comsollauncher --launcher.ini /apps/t3/sles12sp2/isv/comsol/comsol53a_u3/multiphysics/bin/glnxa64/comsolcluster.ini

r2i3n4
Tue Jul 17 14:43:38 JST 2018
GSICUSER 22310 1742  1.5 12019600 3981912 ?    Sl   14:30 221:27 /apps/t3/sles12sp2/isv/comsol/comsol53a_u3/multiphysics/bin/glnxa64/comsollauncher --launcher.ini /apps/t3/sles12sp2/isv/comsol/comsol53a_u3/multiphysics/bin/glnxa64/comsolcluster.ini

2.1.2. バッチジョブスケジューラーUGEによる実行

qsubコマンドによるバッチ投入が可能です。

$ qsub -g [TSUBAME3グループ] スクリプト名

以下のtest.shスクリプトをGSICGROUPに入っているユーザが投入する場合は以下のような例となります。
実際の投入は自分が所属しているグループを指定してください。

$ qsub -g GSICGROUP test.sh

スクリプト例(test.sh)
オプションの詳細についてはTSUBAME3.0利用の手引きのジョブスクリプトをご確認ください。

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
#!/bin/bash
#$ -cwd
#$ -N COMSOL_test_job
#$ -e uge.err
#$ -o uge.out
#$ -l f_node=2
#$ -l h_rt=0:10:00
#$ -V

. /etc/profile.d/modules.sh
module load comsol/53a_u3

export COMSOL_TMPDIR=$TMPDIR

comsol batch -mpibootstrap ssh -mpihosts `awk '{ print $1 }' $PE_HOSTFILE |xargs | sed -e 's/ /,/g'` -nn `cat $PE_HOSTFILE |  wc -l`  -inputfile inputfile.mph -outputfile outputfile.mph

インプットにサンプリファイルmicromixer_cluster_noc.mphを利用した場合のログ(uge.out)
r6i4n4とr2i0n1の2ノードで450秒で計算が完了している。

(r6i4n4:0)
(r2i0n1:1)
Node 0 is running on host: r6i4n4
Node 0 has address: r6i4n4
Node 1 is running on host: r2i0n1
Node 1 has address: r2i0n1
*******************************************
***COMSOL 5.3.1.275 progress output file***
*******************************************
Tue Jul 17 15:54:13 JST 2018
COMSOL Multiphysics 5.3a (Build: 275) starting in batch mode
Opening file: /gs/hs1/tga-hpe_group00/apptest/isv/comsol/comsol/batch/micromixer_cluster_noc.mph
Open time: 6 s.
Running: Study 1
Settings for Cluster Computing 2 are ignored in distributed mode.
<---- Compile Equations: Stationary in Study 1/Solution 1 (sol1) ---------------
Started at 17-Jul-2018 15:54:20.
Geometry shape order: Linear
Running in distributed mode using 2 nodes.
Running on 2 x Intel(R) Xeon(R) CPU E5-2680 v4 at 2.40 GHz.
Using 2 sockets with 28 cores in total on r6i4n4.
Available memory: 257.59 GB.
           Current Progress:   0 % - Free Tetrahedral 1
Memory: 1016/1016 10688/10688
Number of vertex elements: 188
           Current Progress:   1 % - Adjusting boundary mesh
Memory: 1046/1046 10695/10695
Number of edge elements: 1974
Number of boundary elements: 13134
           Current Progress:   1 % - Creating initial tetrahedra
Memory: 1047/1047 10696/10696
           Current Progress:   1 % - Respecting boundaries
Memory: 1049/1049 10697/10697
           Current Progress:   1 % - Inserting interior points
Memory: 1054/1054 10707/10707
           Current Progress:   1 % - Improving element quality
Memory: 1060/1060 10709/10709
Number of elements: 94439
Free meshing time: 1.58s
Minimum element quality: 0.1826
           Current Progress:   1 % - Finalizing mesh
Memory: 1065/1065 10714/10714
<<<<< Node 1 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
Number of vertex elements: 188
Number of edge elements: 1974
Number of boundary elements: 13134
Number of elements: 94439
Free meshing time: 1.66s
Minimum element quality: 0.1826
>>>>> Node 1 >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
           Current Progress:   1 % - Boundary Layers 1
           Current Progress:   1 % - Inserting boundary layer elements
Memory: 1106/1106 10755/10755
           Current Progress:   2 % - Inserting boundary layer elements
Memory: 1107/1107 10755/10755
           Current Progress:   2 % - Smoothing transition to interior mesh
Memory: 1145/1145 10792/10792
           Current Progress:   2 % - Compiling equations
Memory: 1102/1150 10748/10797
           Current Progress:   3 % - Compiling equations
Memory: 1127/1150 10775/10797
Time: 16 s.
Physical memory: 1.15 GB
Virtual memory: 10.8 GB
Ended at 17-Jul-2018 15:54:36.
----- Compile Equations: Stationary in Study 1/Solution 1 (sol1) -------------->
           Current Progress:   3 % - Dependent Variables 1
Memory: 1717/1717 10919/10919
<---- Stationary Solver 1 in Study 1/Solution 1 (sol1) -------------------------
Started at 17-Jul-2018 15:54:38.
           Current Progress:   5 % - Stationary Solver 1
Memory: 1813/1813 11014/11014
Nonlinear solver
Number of degrees of freedom solved for: 747194 (plus 1 internal DOFs).
           Current Progress:   5 % - Assembling matrices
Memory: 2119/2119 11227/11227
           Current Progress:   5 % - Constraint handling
Memory: 2666/2699 11227/11227
           Current Progress:   5 % - Assembling sparsity pattern
Memory: 2674/2699 11227/11227
           Current Progress:   5 % - Assembling matrices
Memory: 3276/3276 11772/11772
           Current Progress:   5 % -
Memory: 3666/5256 11644/13628
Nonsymmetric matrix found.
Scales for dependent variables:
Pressure (comp1.p): 0.074
Velocity field (comp1.u): 0.01
           Current Progress:   5 % - Constraint handling
Memory: 3968/5256 11947/13628
Orthonormal null-space function used.
           Current Progress:   5 % - Matrix factorization
Memory: 3984/5256 11962/13628
Iter      SolEst      ResEst     Damping    Stepsize #Res #Jac #Sol   LinErr   LinRes
           Current Progress:   5 % - Solving linear system
Memory: 10483/10761 19733/20011
           Current Progress:   5 % - Assembling matrices
Memory: 10664/10761 21560/21560
           Current Progress:   5 % - Solving linear system
Memory: 10552/11580 19814/21650
   1          26     1.1e+12   0.0100000          26    2    1    2  2.9e-13  1.4e-15
           Current Progress:   9 % - Solving linear system
Memory: 10570/11580 19829/21650
           Current Progress:   9 % - Assembling sparsity pattern
Memory: 9882/11580 19140/21650
           Current Progress:   9 % - Assembling matrices
Memory: 11181/11580 21890/21890
           Current Progress:   9 % -
Memory: 10713/13485 20021/23523
           Current Progress:   9 % - Constraint handling
Memory: 10704/13485 19960/23523
           Current Progress:   9 % - Matrix factorization
Memory: 10598/13485 19854/23523
           Current Progress:   9 % - Solving linear system
Memory: 10514/13485 19785/23523
           Current Progress:   9 % - Assembling matrices
Memory: 10596/13485 20322/23523
           Current Progress:   9 % - Constraint handling
Memory: 10590/13485 19870/23523
           Current Progress:   9 % - Solving linear system
   2         5.4     1.1e+05   0.1000000           6    3    2    4    3e-13  1.4e-15
-          Current Progress:  14 % - Solving linear system
Memory: 10601/13485 19879/23523
-          Current Progress:  14 % - Assembling sparsity pattern
Memory: 9913/13485 19190/23523
-          Current Progress:  14 % - Assembling matrices
Memory: 11162/13485 21897/23523
-          Current Progress:  14 % -
Memory: 10892/13571 20164/23564
-          Current Progress:  14 % - Constraint handling
Memory: 10821/13571 20092/23564
-          Current Progress:  14 % - Matrix factorization
Memory: 10586/13571 19857/23564
-          Current Progress:  14 % - Solving linear system
-          Current Progress:  14 % - Assembling matrices
Memory: 11007/13571 21688/23564
-          Current Progress:  14 % - Constraint handling
Memory: 10592/13571 19864/23564
-          Current Progress:  14 % - Solving linear system
   3       0.051     8.7e+06   1.0000000        0.62    4    3    6  4.4e-13  2.7e-14
----       Current Progress:  44 % - Solving linear system
Memory: 10608/13571 19887/23564
----       Current Progress:  44 % - Assembling sparsity pattern
Memory: 9920/13571 19199/23564
----       Current Progress:  44 % - Assembling matrices
Memory: 11273/13571 22085/23564
----       Current Progress:  44 % -
Memory: 10718/13843 20048/23813
----       Current Progress:  44 % - Constraint handling
Memory: 10706/13843 19978/23813
----       Current Progress:  44 % - Matrix factorization
Memory: 10596/13843 19868/23813
----       Current Progress:  44 % - Solving linear system
----       Current Progress:  44 % - Assembling matrices
Memory: 10786/13843 21683/23813
----       Current Progress:  44 % - Constraint handling
Memory: 10603/13843 19875/23813
----       Current Progress:  44 % - Solving linear system
   4      0.0026       2e+05   1.0000000       0.043    5    4    8  7.7e-13    2e-14
----       Current Progress:  48 % - Solving linear system
Memory: 10618/13843 19895/23813
----       Current Progress:  48 % - Assembling sparsity pattern
Memory: 10058/13843 19335/23813
----       Current Progress:  48 % - Assembling matrices
Memory: 10995/13843 20521/23813
----       Current Progress:  48 % -
Memory: 11004/14198 20278/24309
----       Current Progress:  48 % - Constraint handling
Memory: 10681/14198 19955/24309
----       Current Progress:  48 % - Matrix factorization
Memory: 10598/14198 19873/24309
----       Current Progress:  48 % - Solving linear system
Memory: 10599/14198 19873/24309
----       Current Progress:  48 % - Assembling matrices
Memory: 11004/14198 21702/24309
----       Current Progress:  48 % - Constraint handling
Memory: 10604/14198 19884/24309
----       Current Progress:  48 % - Solving linear system
   5     2.6e-06     1.9e+02   1.0000000      0.0036    6    5   10  3.4e-13  9.7e-15
-----      Current Progress:  50 % - Solving linear system
Memory: 10620/14198 19900/24309
<<<<< Node 1 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
Nonlinear solver
Number of degrees of freedom solved for: 747194 (plus 1 internal DOFs).
Nonsymmetric matrix found.
Scales for dependent variables:
Pressure (comp1.p): 0.074
Velocity field (comp1.u): 0.01
Orthonormal null-space function used.
Iter      SolEst      ResEst     Damping    Stepsize #Res #Jac #Sol   LinErr   LinRes
   1          26     1.1e+12   0.0100000          26    2    1    2  2.9e-13  1.4e-15
   2         5.4     1.1e+05   0.1000000           6    3    2    4    3e-13  1.4e-15
   3       0.051     8.7e+06   1.0000000        0.62    4    3    6  4.4e-13  2.7e-14
   4      0.0026       2e+05   1.0000000       0.043    5    4    8  7.7e-13    2e-14
   5     2.6e-06     1.9e+02   1.0000000      0.0036    6    5   10  3.4e-13  9.7e-15
>>>>> Node 1 >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
Solution time: 243 s. (4 minutes, 3 seconds)
Physical memory: 14.2 GB
Virtual memory: 24.31 GB
Ended at 17-Jul-2018 15:58:41.
----- Stationary Solver 1 in Study 1/Solution 1 (sol1) ------------------------>
<---- Compile Equations: Stationary 2 in Study 1/Solution 1 (sol1) -------------
Started at 17-Jul-2018 15:58:41.
Geometry shape order: Linear
-----      Current Progress:  50 % - Compiling equations
Memory: 3387/14198 11350/24309
-----      Current Progress:  52 % - Compiling equations
Time: 1 s.
Physical memory: 3.39 GB
Virtual memory: 11.35 GB
Ended at 17-Jul-2018 15:58:42.
----- Compile Equations: Stationary 2 in Study 1/Solution 1 (sol1) ------------>
-----      Current Progress:  52 % - Dependent Variables 2
Memory: 3409/14198 11418/24309
<---- Stationary Solver 2 in Study 1/Solution 1 (sol1) -------------------------
Started at 17-Jul-2018 15:58:44.
-----      Current Progress:  55 % - Stationary Solver 2
Memory: 3487/14198 11487/24309
Nonlinear solver
Number of degrees of freedom solved for: 238542 (plus 30978 internal DOFs).
-----      Current Progress:  55 % - Assembling matrices
Memory: 3492/14198 12378/24309
-----      Current Progress:  55 % - Constraint handling
Memory: 3431/14198 11418/24309
-----      Current Progress:  55 % - Assembling matrices
Memory: 3524/14198 11688/24309
-----      Current Progress:  55 % -
Memory: 3466/14198 11452/24309
Nonsymmetric matrix found.
Scales for dependent variables:
Concentration (comp1.c): 27
Orthonormal null-space function used.
-----      Current Progress:  55 % - Constraint handling
Memory: 3493/14198 11481/24309
-----      Current Progress:  55 % - Matrix factorization
Memory: 3430/14198 11418/24309
Iter      SolEst      ResEst     Damping    Stepsize #Res #Jac #Sol   LinErr   LinRes
-----      Current Progress:  55 % - Solving linear system
Memory: 4204/14198 12341/24309
-----      Current Progress:  55 % - Assembling matrices
Memory: 4257/14198 12430/24309
-----      Current Progress:  55 % - Solving linear system
Memory: 4235/14198 12366/24309
   1        0.66     2.2e+15   0.0100000        0.67    2    1    2  6.5e-13  3.5e-15
-----      Current Progress:  59 % - Assembling matrices
Memory: 4241/14198 12366/24309
-----      Current Progress:  59 % -
-----      Current Progress:  59 % - Assembling sparsity pattern
Memory: 4248/14198 12373/24309
-----      Current Progress:  59 % - Assembling matrices
Memory: 4649/14198 13618/24309
-----      Current Progress:  59 % -
Memory: 4326/14198 12451/24309
-----      Current Progress:  59 % - Constraint handling
Memory: 4382/14198 12507/24309
-----      Current Progress:  59 % - Matrix factorization
Memory: 4279/14198 12404/24309
-----      Current Progress:  59 % - Solving linear system
Memory: 4310/14198 12436/24309
-----      Current Progress:  59 % - Assembling matrices
Memory: 4393/14198 14164/24309
-----      Current Progress:  59 % - Solving linear system
Memory: 4312/14198 12436/24309
   2        0.63       2e+04   0.1000000         0.7    3    2    4  4.6e-13  3.7e-15
------     Current Progress:  64 % -
------     Current Progress:  64 % - Assembling sparsity pattern
Memory: 4313/14198 12436/24309
------     Current Progress:  64 % - Assembling matrices
Memory: 4498/14198 13422/24309
------     Current Progress:  64 % -
Memory: 4360/14198 12483/24309
------     Current Progress:  64 % - Constraint handling
Memory: 4423/14198 12546/24309
------     Current Progress:  64 % - Matrix factorization
Memory: 4281/14198 12404/24309
------     Current Progress:  64 % - Solving linear system
Memory: 4312/14198 12436/24309
------     Current Progress:  64 % - Assembling matrices
Memory: 4367/14198 14164/24309
------     Current Progress:  64 % - Constraint handling
Memory: 4313/14198 12436/24309
------     Current Progress:  64 % - Solving linear system
   3       0.054     7.4e+04   1.0000000          36    4    3    6  4.6e-13  2.9e-15
---------  Current Progress:  90 % -
Memory: 4314/14198 12436/24309
---------  Current Progress:  90 % - Assembling sparsity pattern
---------  Current Progress:  90 % - Assembling matrices
Memory: 4604/14198 13446/24309
---------  Current Progress:  90 % -
Memory: 4301/14198 12422/24309
---------  Current Progress:  90 % - Constraint handling
Memory: 4398/14198 12520/24309
---------  Current Progress:  90 % - Matrix factorization
Memory: 4282/14198 12404/24309
---------  Current Progress:  90 % - Solving linear system
Memory: 4314/14198 12436/24309
---------  Current Progress:  90 % - Assembling matrices
Memory: 4446/14198 14164/24309
---------  Current Progress:  90 % - Constraint handling
Memory: 4315/14198 12436/24309
---------  Current Progress:  90 % - Solving linear system
   4       0.041     3.6e+04   1.0000000       0.073    5    4    8  4.4e-13  4.3e-15
--------   Current Progress:  81 % -
--------   Current Progress:  81 % - Assembling matrices
Memory: 4503/14198 13182/24309
--------   Current Progress:  81 % -
Memory: 4368/14198 12489/24309
--------   Current Progress:  81 % - Constraint handling
Memory: 4431/14198 12552/24309
--------   Current Progress:  81 % - Matrix factorization
Memory: 4283/14198 12404/24309
--------   Current Progress:  81 % - Solving linear system
Memory: 4315/14198 12436/24309
--------   Current Progress:  81 % - Assembling matrices
Memory: 4389/14198 14164/24309
--------   Current Progress:  81 % - Solving linear system
Memory: 4316/14198 12436/24309
   5       0.024       2e+04   1.0000000        0.05    6    5   10  4.4e-13  4.3e-15
--------   Current Progress:  87 % -
Memory: 4317/14198 12436/24309
--------   Current Progress:  87 % - Assembling sparsity pattern
Memory: 4330/14198 12500/24309
--------   Current Progress:  87 % - Assembling matrices
Memory: 4795/14198 13933/24309
--------   Current Progress:  87 % -
Memory: 4367/14198 12487/24309
--------   Current Progress:  87 % - Constraint handling
Memory: 4431/14198 12550/24309
--------   Current Progress:  87 % - Matrix factorization
Memory: 4285/14198 12404/24309
--------   Current Progress:  87 % - Solving linear system
Memory: 4317/14198 12436/24309
--------   Current Progress:  87 % - Assembling matrices
Memory: 4448/14198 14172/24309
--------   Current Progress:  87 % - Constraint handling
Memory: 4323/14198 12444/24309
--------   Current Progress:  87 % - Solving linear system
   6       0.013     1.2e+04   1.0000000       0.027    7    6   12  5.4e-13  3.5e-15
---------  Current Progress:  91 % -
Memory: 4324/14198 12444/24309
---------  Current Progress:  91 % - Assembling sparsity pattern
---------  Current Progress:  91 % - Assembling matrices
Memory: 4550/14198 13391/24309
---------  Current Progress:  91 % -
Memory: 4343/14198 12463/24309
---------  Current Progress:  91 % - Constraint handling
Memory: 4406/14198 12525/24309
---------  Current Progress:  91 % - Matrix factorization
Memory: 4292/14198 12412/24309
---------  Current Progress:  91 % - Solving linear system
Memory: 4324/14198 12444/24309
---------  Current Progress:  91 % - Assembling matrices
Memory: 4399/14198 14172/24309
---------  Current Progress:  91 % - Constraint handling
Memory: 4325/14198 12444/24309
---------  Current Progress:  91 % - Solving linear system
   7      0.0061     8.2e+03   1.0000000       0.014    8    7   14  6.1e-13  2.7e-15
---------  Current Progress:  94 % -
---------  Current Progress:  94 % - Assembling matrices
Memory: 4509/14198 13262/24309
---------  Current Progress:  94 % -
Memory: 4368/14198 12488/24309
---------  Current Progress:  94 % - Constraint handling
Memory: 4431/14198 12550/24309
---------  Current Progress:  94 % - Matrix factorization
Memory: 4324/14198 12443/24309
---------  Current Progress:  94 % - Solving linear system
Memory: 4356/14198 12475/24309
---------  Current Progress:  94 % - Assembling matrices
Memory: 4433/14198 14203/24309
---------  Current Progress:  94 % - Solving linear system
Memory: 4356/14198 12475/24309
   8      0.0033     5.6e+03   1.0000000      0.0063    9    8   16  5.3e-13  2.2e-15
---------  Current Progress:  95 % -
---------  Current Progress:  95 % - Assembling matrices
Memory: 4528/14198 14130/24309
---------  Current Progress:  95 % -
Memory: 4342/14198 12461/24309
---------  Current Progress:  95 % - Constraint handling
Memory: 4405/14198 12524/24309
---------  Current Progress:  95 % - Matrix factorization
Memory: 4293/14198 12412/24309
---------  Current Progress:  95 % - Solving linear system
Memory: 4325/14198 12444/24309
---------  Current Progress:  95 % - Assembling matrices
Memory: 4491/14198 14172/24309
---------  Current Progress:  95 % - Constraint handling
Memory: 4325/14198 12444/24309
---------  Current Progress:  95 % - Solving linear system
   9      0.0021     3.9e+03   1.0000000      0.0033   10    9   18  6.2e-13  2.2e-15
---------  Current Progress:  96 % -
---------  Current Progress:  96 % - Assembling matrices
Memory: 4533/14198 14212/24309
---------  Current Progress:  96 % -
Memory: 4344/14198 12463/24309
---------  Current Progress:  96 % - Constraint handling
Memory: 4407/14198 12525/24309
---------  Current Progress:  96 % - Matrix factorization
Memory: 4293/14198 12412/24309
---------  Current Progress:  96 % - Solving linear system
Memory: 4325/14198 12444/24309
  10      0.0015     2.8e+03   1.0000000      0.0021   11   10   20  5.2e-13  2.1e-15
---------  Current Progress:  97 % - Assembling matrices
---------  Current Progress:  97 % -
---------  Current Progress:  97 % - Assembling matrices
Memory: 4621/14198 14119/24309
---------  Current Progress:  97 % -
Memory: 4352/14198 12471/24309
---------  Current Progress:  97 % - Constraint handling
Memory: 4415/14198 12534/24309
---------  Current Progress:  97 % - Matrix factorization
Memory: 4293/14198 12412/24309
---------  Current Progress:  97 % - Solving linear system
Memory: 4325/14198 12444/24309
---------  Current Progress:  97 % - Assembling matrices
Memory: 4469/14198 14172/24309
---------  Current Progress:  97 % - Solving linear system
Memory: 4325/14198 12444/24309
  11      0.0011     2.1e+03   1.0000000      0.0014   12   11   22    5e-13  2.1e-15
---------  Current Progress:  99 % -
Memory: 4333/14198 12452/24309
---------  Current Progress:  99 % - Assembling matrices
Memory: 4612/14198 14288/24309
---------  Current Progress:  99 % -
Memory: 4386/14198 12505/24309
---------  Current Progress:  99 % - Constraint handling
Memory: 4449/14198 12568/24309
---------  Current Progress:  99 % - Matrix factorization
Memory: 4301/14198 12420/24309
---------  Current Progress:  99 % - Solving linear system
Memory: 4333/14198 12452/24309
---------  Current Progress:  99 % - Assembling matrices
Memory: 4378/14198 14180/24309
---------  Current Progress:  99 % - Solving linear system
Memory: 4333/14198 12452/24309
  12     0.00062     1.6e+03   1.0000000     0.00083   13   12   24  4.7e-13    2e-15
---------- Current Progress: 100 % -
<<<<< Node 1 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
Nonlinear solver
Number of degrees of freedom solved for: 238542 (plus 30978 internal DOFs).
Nonsymmetric matrix found.
Scales for dependent variables:
Concentration (comp1.c): 27
Orthonormal null-space function used.
Iter      SolEst      ResEst     Damping    Stepsize #Res #Jac #Sol   LinErr   LinRes
   1        0.66     2.2e+15   0.0100000        0.67    2    1    2  6.5e-13  3.5e-15
   2        0.63       2e+04   0.1000000         0.7    3    2    4  4.6e-13  3.7e-15
   3       0.054     7.4e+04   1.0000000          36    4    3    6  4.6e-13  2.9e-15
   4       0.041     3.6e+04   1.0000000       0.073    5    4    8  4.4e-13  4.3e-15
   5       0.024       2e+04   1.0000000        0.05    6    5   10  4.4e-13  4.3e-15
   6       0.013     1.2e+04   1.0000000       0.027    7    6   12  5.4e-13  3.5e-15
   7      0.0061     8.2e+03   1.0000000       0.014    8    7   14  6.1e-13  2.7e-15
   8      0.0033     5.6e+03   1.0000000      0.0063    9    8   16  5.3e-13  2.2e-15
   9      0.0021     3.9e+03   1.0000000      0.0033   10    9   18  6.2e-13  2.2e-15
  10      0.0015     2.8e+03   1.0000000      0.0021   11   10   20  5.2e-13  2.1e-15
  11      0.0011     2.1e+03   1.0000000      0.0014   12   11   22    5e-13  2.1e-15
  12     0.00062     1.6e+03   1.0000000     0.00083   13   12   24  4.7e-13    2e-15
>>>>> Node 1 >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
Solution time: 178 s. (2 minutes, 58 seconds)
Physical memory: 4.8 GB
Virtual memory: 14.29 GB
Ended at 17-Jul-2018 16:01:42.
----- Stationary Solver 2 in Study 1/Solution 1 (sol1) ------------------------>
Run time: 443 s.
Saving model: /gs/hs1/tga-hpe_group00/apptest/isv/comsol/comsol/batch/micromixer_cluster_noc5.mph
Save time: 1 s.
Total time: 450 s.
---------- Current Progress: 100 % - Done
Memory: 3660/14198 11634/24309

2.1.3. ライセンス使用状況の確認

ライセンス数や利用状況については下記コマンドで確認してください。

$ lmutil lmstat -S LMCOMSOL -c 27009@lice0:27009@remote:27009@t3ldap1