Consolidate Domain Decomposition - Revision history

Miranda ricardo: /* Run the program */

2015-03-09T15:52:47Z

‎Run the program

2015-03-09T15:52:32Z

‎Run the program

2015-03-09T15:52:08Z

‎Run the program

2015-03-09T15:51:48Z

2015-02-03T11:37:13Z

‎Topology

2015-02-03T11:34:03Z

2014-11-30T19:41:09Z

‎Topology

2014-11-30T19:31:32Z

‎Topology

2014-11-30T19:21:17Z

‎Topology

2014-11-30T19:20:12Z

‎Topology

@@ Line 11: / Line 11: @@
 To run the program go to the directory where the file "Tree.dat" is. Most likely you will run on a single machine, the number of Parsers must be 1, the number of Workers can be any number greater then 1. There should be a balance between the number of available cores and the number of files to join. The application parses the "MPI_*_DecomposedFiles.dat" produced by Mohid. The consolidated files are placed in the same directory where the decomposed files are. The command to run the application is:
-* mpiexec -localonly -n 1 DDCParser.exe : -n 2  DDCWorker.exe
+* mpiexec.exe -localonly -n 1 DDCParser.exe : -n 2  DDCWorker.exe
 == Topology ==

@@ Line 11: / Line 11: @@
 To run the program go to the directory where the file "Tree.dat" is. Most likely you will run on a single machine, the number of Parsers must be 1, the number of Workers can be any number greater then 1. There should be a balance between the number of available cores and the number of files to join. The application parses the "MPI_*_DecomposedFiles.dat" produced by Mohid. The consolidated files are placed in the same directory where the decomposed files are. The command to run the application is:
-mpiexec -localonly -n 1 DDCParser.exe : -n 2  DDCWorker.exe
+* mpiexec -localonly -n 1 DDCParser.exe : -n 2  DDCWorker.exe
 == Topology ==

@@ Line 10: / Line 10: @@
 Both Windows and *NIX systems run the same way. This application runs from the command line.
 To run the program go to the directory where the file "Tree.dat" is. Most likely you will run on a single machine, the number of Parsers must be 1, the number of Workers can be any number greater then 1. There should be a balance between the number of available cores and the number of files to join. The application parses the "MPI_*_DecomposedFiles.dat" produced by Mohid. The consolidated files are placed in the same directory where the decomposed files are. The command to run the application is:
 mpiexec -localonly -n 1 DDCParser.exe : -n 2  DDCWorker.exe

@@ Line 5: / Line 5: @@
 *hyd_submod_1.hdf and hyd_submod_2.hdf to produce hyd.hdf; and
 *wq_submod_1.hdf and wq_submod_2.hdf for the wq.hdf
 == Topology ==

@@ Line 11: / Line 11: @@
 *any number of workers.
-The Parser identifies result files to be consolidated. It keeps 2 lists:
+The Parser identifies result files to be consolidated. It keeps a list of jobs to be done.
-*a list of jobs to be done; and
+At the end, when all files are merged, a "poison pill" message will be broadcast notifying workers they must terminate.
 The list of jobs works like this:
 #a Worker is idle it sends a request to the Parser;

@@ Line 9: / Line 9: @@
 [[File:Ddc.rcm.png|thumb|left|alt=Diagram of the architecture for the consolidation of domain decomposition HDF result files.]]There are 2 kinds of MPI processes running:
 *a Parser; and
-*2 workers.
+*any number of workers.
 The Parser identifies result files to be consolidated. It keeps 2 lists:

@@ Line 20: / Line 20: @@
 #when a Worker terminates a job sends a processed message to the Parser;
 #the Parser removes the completed job from the list.
-This strategy for the jobs list ensures fault tolerance.
+This strategy for the jobs list ensures fault tolerance. Suppose a job is sent to a Worker that, for some reason, does not complete it. That job will eventually be send to another Worker. It may occur that a job is executed twice but the program is idempotent so no harm occurs...

@@ Line 7: / Line 7: @@
 == Topology ==
-[[File:Ddc.rcm.png|thumb|left|alt=Domain in decomposed in 3 subdomains creates 3 instances of MohidWater (MW1, MW2 and MW3).|Domain in decomposed in 3 subdomains.]] There are 2 kinds of MPI processes running:
+[[File:Ddc.rcm.png|thumb|left|alt=Domain in decomposed in 3 subdomains creates 3 instances of MohidWater (MW1, MW2 and MW3).|Domain in decomposed in 3 subdomains.]]There are 2 kinds of MPI processes running:
 *a parser; and
 *2 workers.