Guillaume: 1 revision

2008-12-03T10:38:59Z

1 revision

192.168.20.177: /* Relevant locations */

2008-04-11T14:10:44Z

‎Relevant locations

New page

This article describes the Mercator-IST operational system timeline.

==Committed Computer Resources==
*Maretec-IST intranet
*Hidromod-IST intranet
*\\guillaume
*\\192.168.23.151 or \\Dual_64
*<strike>\\kepler</strike> \\alexandria
*\\data.mohid.com

===Relevant locations===
====\\guillaume\Data\Mercator====
is the temporary folder where the netcdf files from Mercator arrive every week and where they are converted into HDF5. Two HDF5 files are created per week. One for the Analyzed results of the past 7 days (labeled '''ANA'''). And one for the Predicted results of the coming 14 days (labeled '''PRE''').

====\\guillaume\Aplica\PreOp-Model\GeneralData====
is the folder where the interpolations from the Mercator grid and MM5 grids to the Mohid grids are made.

====\\guillaume\Aplica\PreOp-Model\WestIberia====
is the folder where the post-processing is made to the results from the model every week.

====\\192.168.23.151 or \\Dual_64... \Aplica\PreOpModel====
is the folder where the model is run every week.

====<strike>\\kepler\DataCenter\Modelos\Mercator-IST</strike> \\alexandria\public\modelos\Mercator-IST====
is the folder where the results in netcdf and in hdf5 from Mercator-Océan are stored for futur use.

====\\data.mohid.com\data====
is the folder where the results in netcdf from MOHID are stored for publication via OpenDap.

==Scheduled jobs==
Here's so far the approximate scheduling of the pending jobs on their respective locations:

===\\guillaume===
#19:00 Thursday - Mercator Results mail reception
#20:00 Thursday - '''Mercator-weekly'''
#02:00 Friday - '''Interpol-weekly'''
#12:00 Friday - MM5 results
#17:05 Friday - '''InterpolMM5-weekly'''
#00:30 Monday - '''PostRun-weekly'''
#04:00 Monday - '''PostRunHIDROMOD-weekly'''

===\\192.168.23.151\guillaume===
0 2 * * 6 /home/guillaume/Aplica/PreOp-Model/WestIberia_ET2_2K4/exe/CreateRun.sh
30 2 * * 6 /home/guillaume/Aplica/PreOp-Model/WestIberia_ET2_2K4/exe/ MailRun.sh
0 2 * * 1 /home/guillaume/Aplica/PreOp-Model/WestIberia_ET2_2K4/exe/MailRun.sh
0 4 * * * /home/guillaume/Desktop/wgetwiki.sh
0 3 * * * /home/guillaume/Aplica/PreOp-Model/cronjob.sh

==Actions StoryLine==
===Mercator-Weekly===
# Calculate date and run ID
# Access mercator ftp site and get all 63 netcdf files
# Gunzip netcdf files
# Gunzip last week last day netcdf file
# convert to HDF5 the netcdf files for the analysis period
# convert to HDF5 the netcdf files for the prediction period
# Gzip back last week netcdf file
# Gzip back the netcdf files
# Transfer the netcdf files to '''\\kepler'''
# Transfer the HDF5 files to '''\\kepler'''
# Pass the run ID to the interpolation folder in '''\\guillaume'''
# Send an acknowledgement email to Mercator

===Interpol-Weekly===
# Read the run ID
# Glue the Analysis and Prediction HDF5 files to a Mercator HDF5 file
# Interpolate the Mercator HDF5 to the Portugal grid producing a Portugal HDF5 file
# Analyze the Portugal HDF5 and create a PortugalAnalyzed HDF5 file (barotropic flux)
# Copy the Portugal HDF5 file to '''\\192.168.23.151'''
# Copy the PortugalAnalyzed HDF5 file to '''\\192.168.23.151'''
# Interpolate the Mercator HDF5 to the Estremadura grid producing a Estremadura HDF5 file
# Analyze the Estremadura HDF5 and create a EstremaduraAnalyzed HDF5 file (barotropic flux) '''NOT NECESSARY'''
# Copy the Estremadura HDF5 file to '''\\192.168.23.151'''
# Copy the EstremaduraAnalyzed HDF5 file to '''\\192.168.23.151'''
# Pass the run ID to the MM5 interpolation folder in '''\\guillaume'''
# Send an acknowledgement email to administrator

===InterpolMM5-Weekly===
# Read the run ID
# Glue this week MM5 HDF5 with last week MM5 file for domains D2 and D3
# Patch D2 and D3 HDF5 files for the Portugal grid producing a Portugal HDF5 file
# Copy the Portugal HDF5 file to '''\\192.168.23.151'''
# Patch D2 and D3 HDF5 files for the Estremadura grid producing a Estremadura HDF5 file
# Copy the Estremadura HDF5 file to '''\\192.168.23.151'''
# Pass the run ID to the MM5 interpolation folder in '''\\192.168.23.151'''
# Send an acknowledgement email to administrator

===CreateRun===
# Read the run ID
# Calculate the START and END times
# Create the dat files with the run ID
# Run MohidWater as a forked process and returning output to a log file

===MailRun===
# Read the run ID
# Tail the run log file to a status file
# Send an email with the status file to the administrator

===PostRun-Weekly===
# Get the run ID file from '''\\192.168.23.151'''
# Read the run ID
# Get the log file from '''\\192.168.23.151'''
# Match "''succefully''" string in log file
# Copy the Portugal Hydrodynamic HDF5 file from '''\\192.168.23.151'''
# Copy the Portugal WaterProperties HDF5 file from '''\\192.168.23.151'''
# Convert to netcdf the Portugal Hydrodynamic HDF5 file
# Copy the netcdf Portugal Hydrodynamic file to '''\\data.mohid.com'''
# Convert to netcdf the Portugal WaterProperties HDF5 file
# Copy the netcdf Portugal WaterProperties file to '''\\data.mohid.com'''
# Copy the Estremadura Hydrodynamic HDF5 file from '''\\192.168.23.151'''
# Copy the Estremadura WaterProperties HDF5 file from '''\\192.168.23.151'''
# Convert to netcdf the Estremadura Hydrodynamic HDF5 file
# Copy the netcdf Estremadura Hydrodynamic file to '''\\data.mohid.com'''
# Convert to netcdf the Estremadura WaterProperties HDF5 file
# Copy the netcdf Estremadura WaterProperties file to '''\\data.mohid.com'''
# Send an acknowledgement email to administrator

===PostRunHIDROMOD-Weekly===
# Get the run ID file from '''\\192.168.23.151'''
# Read the run ID
# Get the log file from '''\\192.168.23.151'''
# Match "''succefully''" string in log file
# Copy the Portugal Hydrodynamic HDF5 file from '''\\192.168.23.151''' to '''\\192.168.24.11\c$\www\OperationalResults'''
# Copy the Portugal WaterProperties HDF5 file from '''\\192.168.23.151''' to '''\\192.168.24.11\c$\www\OperationalResults'''
# Copy the Portugal Atmosphere HDF5 file from '''\\192.168.23.151''' to '''\\192.168.24.11\c$\www\OperationalResults'''
# Send an acknowledgement email to administrator and end-users

==External References==
*[http://data.mohid.com/index.xml data.mohid.com],
*[http://data.mohid.com/data.xml model results in netcdf datasets],
*[http://data.mohid.com/las.xml Access to a LAS].

[[Category:Operational Modeling]]

← Older revision	Revision as of 10:38, 3 December 2008
(No difference)

OpModel TimeLine - Revision history

Guillaume: 1 revision

192.168.20.177: /* Relevant locations */