Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

updates for cheyenne and full SGI MPT support #70

Merged
merged 5 commits into from
Apr 25, 2017
Merged

Conversation

bertinia
Copy link
Contributor

Update to cheyenne specific settings.
Upgrade to subtrees for newer releases or ASAPPyTools (v0.6.0) and PyReshaper (v1.0.0)

b9ffae4 Merge pull request NCAR#12 from NCAR/devel
3cb063a Updating README
8d1965c Removing NumPy dependency.  Not absolutely needed.
6a7373d Adding NumPy dependence.
4ce4262 Updating change log
59979fd Fixing tests to work with Python3 (no hanging)
b98c611 Appropriate list conversions to work with Python3
17dfc87 Importing print_function from future
47286c4 Correcting test to work (still) with Python2.6
49204eb Updating vprinter to work with Python3
f5a5957 Updating time-keeper tests to Python3
28a1d50 Updating SimpleComm code to work with Python3.  Seems to be hanging...
31e1447 Updating partition code to work with Python3
cb384db Suppressing Eclipse warnings
c082f73 Adding back import.  Was used, just not observed by Eclipse.
d5d7a61 Removing unused import
a548305 Bump version number
5b3cc56 Updating change log.  Reversing order.

git-subtree-dir: mpi_utils/pyTools
git-subtree-split: b9ffae42dee7d40bd8796eadf6f51c11128330a8
769e587 Merge pull request NCAR#29 from NCAR/devel
95fcbe6 Merge pull request NCAR#28 from NCAR/chunking
7f1ebbb Adding ability to produce speedup plots
1a81993 Add ability to plot log plots and subselected jobs by data
4d65341 Adding functionality to plot log bar plots
17337ab Merge branch 'chunking' of https://github.com/NCAR/PyReshaper into chunking
f5716ae Formatting only.
db18732 New YS 8x16 (128 proc) timings.
8a27c17 New timings for 4x4 YS runs.
f0ceb7e BUGFIX:  Wrong checks when generating plots.  Also resizing.
7a69d4e New Yellowstone timing numbers.
d4cd015 Merge branch 'chunking' of https://github.com/NCAR/PyReshaper into chunking
5f366c1 Changing pop-0.1deg chunking to fit in yellowstone memory.
7f33829 Adding to change log.
883eeab Adding chunking documentation to manual
738d310 Bumping up pop-0.1deg chunk size
1d4598a Copying version 0.X timings into new database for comparisons
1d612ba Renaming new timings database to default name
b960ddc Renaming old timings file to match old version
c691b15 New timings database for new PyReshaper version
27b420c Changing to indicate read chunk sizes only (write are same)
b8e49e2 Attempt to adjust chunk sizes.
81b0223 Merge branch 'chunking' of https://github.com/NCAR/PyReshaper into chunking
66ca398 Set camfv-1deg chunk sizes to none (read/write whole variables)
e635b00 Merge branch 'chunking' of https://github.com/NCAR/PyReshaper into chunking
57b2fe6 Moving sync location in convert
82395f5 BUGFIX: Wrong capitalization when attempting to call getdb()
5627dca Adding a message about the chunk sizes used.
47109f1 Fixing typo in warning message
4eed760 Adding chunking parameters to testinfo database.
b84c7ad Merge pull request NCAR#27 from NCAR/devel
fb809a4 BUGFIX: Datatype must be converted to a numpy dtype
c3c204c Revert "Working on updating to Python3"
0de3b37 Revert "Updating IOBackend tests to work with Python 2.6+"
3a3f1d8 Revert "Updating to work with Python2.6+"
2f0fc2c Revert "Updating to work with Python2.6+"
66374d9 Updating to work with Python2.6+
a8f0fc2 Updating to work with Python2.6+
232406a Updating IOBackend tests to work with Python 2.6+
549ddf9 Working on updating to Python3
3350d71 Simplifying chunking argument parsing
f703b59 Suppressing PyDev error
82cbcc0 Cleanup and passing in chunks to Reshaper convert method
48b4740 Enabling chunking via command-line script
17e98ad Adding ability to create new timings file at runtime.
3556e9b Adding ability to read/write separate timings files
62d0173 Removing NetCDF compare tool.  Try to use cprnc.
d413515 Adding pretty-print to output
8b3c256 Allowing backwards-compatibility with older netCDF4
b34445f Removing conflict with parser's help option
93ab872 One more modification
59155ad Making the script executable from the command line
ae172ca Adding a NetCDF compare tool
533756b Merge branch 'devel' of https://github.com/NCAR/PyReshaper into devel
e5ed2ac Adding module load to init and ignoring results directory.
68a3e3c Bugfix.  Need to set default chunking after unlimited dim is found.
d1c4edd Some cleanup and restructuring.
4343273 First pass at actual chunking code
5a07d3a Not printing 'usage'.  Printing 'use'.
a66c288 Merge pull request NCAR#25 from NCAR/memory_diag
af921ec Adding maximum memory usage diagnostic output
04ff328 Merge pull request NCAR#24 from NCAR/extract_only
df9e99c Updated changelog file.  No more dates.  Reverse order.
a2c3e47 Updating the manual to describe the new extract-only features
f31a7a0 Adding command-line option to extract only some time-series variables
c3d06e8 Extract only some variables seems to work from Python side.
79af819 Checking extract_only tests.  Appears to work, but needs more testing.
58eeb21 Updating specification tests to include time-series name list
13578d2 Updated GitHub references
2567496 First pass as modifying reshaper to use explicit time-series name list
031cfda Modifying specification to take time-series name list
7f7fa13 Merge pull request NCAR#23 from NCAR/default_1D_metadata
b4ec088 Updating manual for new feature
c87bafc Finished adding option to assert all 1d time-var variables are metadata
568d534 Cleanup:  Better allowances for netCDF4-python v1.1.1
95aaf34 attempting to add netCDF4 v1.1.1 support
38ab628 Updating bakeoff data location on GLADE
9f55a5e Need to repr the wmode argument when writing script (must be str)
f78f002 Bugfix
670edfa Backporting checkresults to Python 2.6
cc0a772 Bugfix:  more specfile extension changing
cbed5cd Bugfix:  specfile has extension s2s
38fef51 bugfix
f1de114 Bugfix and changing usage statements
cf29b54 More formatting of descriptions
601081d Updating descriptions of test utilities
dbff464 Backporting YS tests to Python version 2.6
fed167e Merge pull request NCAR#22 from NCAR/iobackend
7aa5477 Updating README to be consistent with manual.
12aa9e3 Updating CHANGELOG
44823f9 Updating user documentation
0a8d18b Updating comments only.
f5e7ad7 Modifying CHANGES log
f3b6041 Formatting only.
a38aa2a Updating changelog.
6eab81b Cleaning up iobackend branch, allowing I/O backend to be set by default
f762a67 Moved I/O backend info output to initialization
69548a0 More output about the NetCDF output settings.
7b0f71b Allowing the use of Python 2.6 ordereddict module, if available
6cd1d9f Changing the default backend to PyNIO (tests suggest it's faster)
74e497c Removing unnecessary import
915bf1c Updating tests with new names
469a0e0 Implementing use of new get_value/assign_value functions
b557895 Adding get_value and assign_value methods for general get/set
e26ffb1 Attempting to convert typecode 'S' to 'c' when using PyNIO
e8bd27a Casting datatype to string in Nio create_variable
d82aacc Adding user-level output on which I/O backend is being used.
9cdad55 Adding option for I/O backend to s2smake (stored in specfile)
562f6c4 Updating to new iobackend changes
6df401a Removing debug output. Changing 'typecode' str to 'datatype' Numpy.dtype
19ced93 More debugging info.
0634559 Adding debug output.
ee97a88 Switching PyReshaper objects over to new iobackend
dae810d Adding specifier checks on backend
49c081f Adding shape and size methods to NCVariable
3ed54aa Adding append tests.  All tests pass.
8b72ef5 Added write tests.  All are passing.
7c56210 Cleaned up API.  Switched to netCDF4 way of dealing with attributes.
0c3cfd8 Now adding iobackend and tests.
43cc6d8 Updated copyright info.  Added iobackend module and started tests.
2257386 Removing MultiSpecReshaper reference from factory function
18b5359 Removing MultiSpecReshaper
139f708 Starting work on new memory-management system/partitioner

git-subtree-dir: reshaper/pyReshaper
git-subtree-split: 769e587dabe15c0ecaf4d0c2903152a12ae640ce
@bertinia bertinia merged commit fd7a805 into NCAR:master Apr 25, 2017
bertinia added a commit to bertinia/CESM_postprocessing that referenced this pull request Jun 21, 2018
5034a4d Merge pull request NCAR#74 from NCAR/devel
488962b Merge pull request NCAR#73 from NCAR/fix_request_bug
c0159aa Create workaround for bug in data request version 01.00.25
738f0d0 Merge pull request NCAR#72 from NCAR/devel
a5a0962 Merge pull request NCAR#71 from NCAR/more_defs
626ad46 Code needed to get more definitions working
a547f38 Merge pull request NCAR#70 from NCAR/add_functions
96de7cc Add extra functions
0631b1e Merge pull request NCAR#69 from NCAR/updates
2c01173 Additional Functionality
e008005 Bugfix for format string
027653b Formatting only.
44481bc Merge branch 'devel' of https://github.com/NCAR/PyConform.git into devel
f8f7221 Adding manual time conversion test
30d7c67 Merge pull request NCAR#68 from NCAR/updates_for_defs
517453d Updates needed to get more definitions to work and to meet the specifications.
b1e364b Adding allowance to remove chunked sumlike dims if debug enabled
5739755 Bugfix: need to check if dimension in input dataset first
d4f0cce Better error message
0d500bf Forgot loop over args
2a9d138 Fixing missing uses of new parsed types
4f1c581 Adding parsetab back and disabling debug
643c7bd Adding parse tables.
77fd6f8 Forgot to update the vardeps script to work with new parser
56d8149 Only need one OpType
aa032f0 Update to use new lex/yacc parser
4573337 Ignoring ply output files
5f7a298 Replacing pyparsing parser with lex/yacc parser
c5657db Adding lex/yacc-based parser
06f11c5 Merge pull request NCAR#67 from NCAR/zonalmean
fe124bd Added zonal mean fix division function bug Added the zonalmean function The division function had a minus sign as its symbol.  Switched it to a division sign. (Still hanging on the one aerosol equation for emibvoc)
cd2140d Merge pull request NCAR#66 from NCAR/def_updates
b908a51 Add an input_glob attribute to the variable in the json file -Will add this from a comment in the def file. -These are glob streams to search for the input
b7b7f8c Merge pull request NCAR#65 from NCAR/def_updates
62bebc3 Add in modules for land varaibles Remove an underscore in the output file name to match the request
8a75d77 BUGFIX: Need to check for dimensions in input dataset when mapping
84351e2 Exabling writing to temporary file and then renaming
662f973 bump version

git-subtree-dir: conformer/conformer
git-subtree-split: 5034a4d4576db6df84fb76732653b330a3e7bc32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant