Staging v1.12.0 beta.1 #1771

ddimatos · 2024-10-27T22:10:02Z

SUMMARY

Release version 1.12.0-beta.1 merge into main, addresses #1699

…r-job-submit [zos_job_submit] Fix undefined variable

…te-sanity-test-ignore-9-11 Update zos job submit undocumented argument and import exception

…datasets

https://github.com/ansible-collections/ibm_zos_core into enabler/Test_zos_fetch_find_remove_hardcoded_datasets

…tch_find_remove_hardcoded_datasets Test zos fetch find remove hardcoded datasets

…tack trace as the msg (#1078) * Add types to better_args_parser * Remove unused re import * Manage spaces * Manage documentation * Manage documentation * Modify regex * Modify regex * Add fragment * Test cases * Change bool to str * Solve documentation * Remove runtime error * Remove re * Test case for owner and job id and add to changelog * Cover all cases

#1163) * Refactor zos copy and test case fixed

Signed-off-by: ddimatos <[email protected]>

Conflicts: .github/ISSUE_TEMPLATE/bug_issue.yml CHANGELOG.rst README.md ac changelogs/.plugin-cache.yaml changelogs/changelog.yaml docs/source/modules/zos_copy.rst docs/source/modules/zos_fetch.rst docs/source/modules/zos_job_query.rst docs/source/modules/zos_job_submit.rst docs/source/modules/zos_operator.rst docs/source/release_notes.rst docs/source/resources/releases_maintenance.rst galaxy.yml meta/ibm_zos_core_meta.yml plugins/action/zos_copy.py plugins/action/zos_script.py plugins/module_utils/backup.py plugins/module_utils/better_arg_parser.py plugins/module_utils/copy.py plugins/module_utils/data_set.py plugins/module_utils/encode.py plugins/module_utils/job.py plugins/module_utils/mvs_cmd.py plugins/module_utils/vtoc.py plugins/module_utils/zos_mvs_raw.py plugins/modules/zos_apf.py plugins/modules/zos_archive.py plugins/modules/zos_backup_restore.py plugins/modules/zos_blockinfile.py plugins/modules/zos_copy.py plugins/modules/zos_data_set.py plugins/modules/zos_encode.py plugins/modules/zos_fetch.py plugins/modules/zos_job_query.py plugins/modules/zos_job_submit.py plugins/modules/zos_lineinfile.py plugins/modules/zos_mvs_raw.py plugins/modules/zos_operator.py plugins/modules/zos_script.py plugins/modules/zos_unarchive.py scripts/hosts.env scripts/info.env.axx scripts/mounts.env scripts/mounts.sh scripts/venv.sh tests/conftest.py tests/functional/modules/test_zos_apf_func.py tests/functional/modules/test_zos_backup_restore.py tests/functional/modules/test_zos_blockinfile_func.py tests/functional/modules/test_zos_copy_func.py tests/functional/modules/test_zos_data_set_func.py tests/functional/modules/test_zos_encode_func.py tests/functional/modules/test_zos_fetch_func.py tests/functional/modules/test_zos_find_func.py tests/functional/modules/test_zos_job_query_func.py tests/functional/modules/test_zos_job_submit_func.py tests/functional/modules/test_zos_lineinfile_func.py tests/functional/modules/test_zos_mvs_raw_func.py tests/functional/modules/test_zos_operator_func.py /functional/modules/test_zos_script_func.py tests/functional/modules/test_zos_tso_command_func.py

Signed-off-by: ddimatos <[email protected]>

docs/source/modules/zos_fetch.rst

richp405

A grammatical issue in some docs... no show-stoppers. You are a merge maniac.

Signed-off-by: ddimatos <[email protected]>

fernandofloresg

What a piece of PR... left one comment which does not need to be changed, but rather is a nice to have.

plugins/modules/zos_blockinfile.py

Signed-off-by: ddimatos <[email protected]>

* Fix fetch * Fix find and continue with fetch * Catalog a vsam * Catalog a vsam * Catalog a vsam * Add name to vsam * Add name to vsam * Add name to vsam * Add name to vsam * Delete and add names to pds with member * Remove other modules dependencies * Remove hardcoded content * Modified variable definitions * removed variable assignments * Changed IMSTESTL name * Add fragment * [Bugfix][v1.9.0]short job name sends back a value error with a full stack trace as the msg (#1078) * Add types to better_args_parser * Remove unused re import * Manage spaces * Manage documentation * Manage documentation * Modify regex * Modify regex * Add fragment * Test cases * Change bool to str * Solve documentation * Remove runtime error * Remove re * Test case for owner and job id and add to changelog * Cover all cases * [Enabler][zos_copy]Refactor calls to use new alias and execute options (#1163) * Refactor zos copy and test case fixed * Update ZOAU list to include v1.3.0 (#1166) * [v1.10.0][zos_lineinfile] Removed zos_copy dependency from test cases (#1152) * Changed zos_copy to echo * Modified test case * Added changelog * [v1.10.0][zos_fetch] Remove zos_copy dependency from test cases (#1165) * Removed zos_copy from zos_fetch test cases * Added trailing char * Initial commit * Updated changelog * removed old fragment * Update 1165-remove-zos-copy-dep-from-zos-fetch.yml * [v1.10.0][zos_encode] Remove zos_copy dependency from test cases (#1157) * Removed zos_copy dependency * Added changelog * [v1.10.0][zos_archive] Remove zos_copy depedency from test cases (#1156) * removed zos_copy from zos_archive tests * Added changelog * [v1.10.0][zos_blockinfile] Remove zos_copy from test cases (#1167) * Removed zos_copy from test cases * Added changelog * Added file creation * [v1.10.0][zos_lineinfile] Remove zos encode from zos lineinfile (#1179) * Started removing encoding from tests * WIP * WIP * Added conversion * Removed zos_encode * Added changelog * Removed unused code * [v1.10.0] [zos_copy] Enhance zos_copy performance when copying multiple PDS members (#1183) * [v1.9.0] [zos_copy] Enhancement/764/copy members (#1176) * Changed member copy into a bulk call * Modified copy to members * Cleaned code * Removed hardcoded content from zos_copy tests * Added fix for uss files * Added distinction between uss and mvs * Added alias fix * Moved the copy section to below * Modified for seq test * Added fix for copy dest lock * Added msgs for debugging * Added final changes to member copy * Added copy for when seq to pdse * Add changelog * Added a line into docs * Modified doc * Modified doc * Update changelog * Created a new changelog * Corrected typo * zos_operator - ZOAU 1.3.0 migration (#1181) * adjust value of timeout param which the module measures in seconds to centiseconds for zoau v1.3.x+ migration Signed-off-by: Ketan Kelkar <[email protected]> * rename timeout param in helper functions to distinguish unit of measurement - timeout_s and timeout_c Signed-off-by: Ketan Kelkar <[email protected]> * add changelog Signed-off-by: Ketan Kelkar <[email protected]> * update copyright year Signed-off-by: Ketan Kelkar <[email protected]> --------- Signed-off-by: Ketan Kelkar <[email protected]> Co-authored-by: Fernando Flores <[email protected]> * [v1.10.0] [Enabler] [job] ZOAU v1.3.0 migration for job.py (#1169) * Update calls to jobs * Update copyright years * Add changelog fragment * Rename changelog fragment * Fix references to None types * Update 1169-util-job-zoau-migration.yml --------- Co-authored-by: Fernando Flores <[email protected]> * [v1.10.0] [module_utils/copy.py] Implement ZOAU 1.3 migration changes into module_utils/copy.py (#1187) * Replaced zoau datasets import * Updated changelog * Updated changelog * Modified copyright year * Update 1187-migrate-module-utils-copy.yml * [v1.10.0] [module_utils/dd_statement.py] Implement ZOAU 1.3 migration changes into module_utils/dd_statement.py (#1190) * Migrated module_utils/dd_statement * Added changelog * Update 1190-migrate-module_utils-dd_statement.yml * [v1.10.0] [module_utils/backup.py] Implement ZOAU 1.3 migration changes into module_utils/backup.py (#1188) * Changed datasets call to zoau 1.3 * Updated changelog * Corrected changelog location and tag * Corrected copyright dates * Removed wrong exception raise * Removed unused var * [v1.10.0][module_utils/data_set.py] Implement ZOAU 1.3 migration changes into module_utils/data_set.py (#1182) * Made changes to module utils * Added traceback import * Updated changelog * Changed year * Updated zoau import * Update 1182-migrate-module-utils-data-set.yml * Changed build zoau args to dataset type * [Enabler] [zos_copy] Remove zos_fetch call in loadlib test (#1184) * Remove zos_fetch call in loadlib test * Add changelog fragment * Change use of cp to dcp * Add delay to last zos_copy call * Change dcp call * Disable cleanup temporarily * Change tmp dir used * Change scp for sftp * Turn cleanup on once again * Removed print statement --------- Co-authored-by: Fernando Flores <[email protected]> * [v1.10.0] [module_utils/encode.py] Implement ZOAU 1.3 migration changes into module_utils/encode.py (#1189) * Updated module_utils encode * Updated changelog * Update 1189-migrate-module_utils-encode.yml * Modified datasets.create call * Changed datasets.create call * [v1.10.0] [zos_gather_facts] ZOAU 1.3 migration - zos_gather_facts (#1196) * update module to leverage zoau python api for zinfo Signed-off-by: Ketan Kelkar <[email protected]> * add changelog fragment Signed-off-by: Ketan Kelkar <[email protected]> * address pep8 issues Signed-off-by: Ketan Kelkar <[email protected]> * update catch-all error message Signed-off-by: Ketan Kelkar <[email protected]> --------- Signed-off-by: Ketan Kelkar <[email protected]> * [v1.10.0] [zos_backup_restore]Added choices for space type (#1200) * Added choices for space type * Added changelog * Cherry picked removed hard coded content from staging-v1.9.0-beta.1 (#1194) * Cherry picked removed hard coded content from staging-v1.9.0-beta.1 Added preferred volumes changes [v1.10.0] [zos_copy] Enhance zos_copy performance when copying multiple PDS members (#1183) * [v1.9.0] [zos_copy] Enhancement/764/copy members (#1176) * Changed member copy into a bulk call * Modified copy to members * Cleaned code * Removed hardcoded content from zos_copy tests * Added fix for uss files * Added distinction between uss and mvs * Added alias fix * Moved the copy section to below * Modified for seq test * Added fix for copy dest lock * Added msgs for debugging * Added final changes to member copy * Added copy for when seq to pdse * Add changelog * Added a line into docs * Modified doc * Modified doc * Update changelog * Created a new changelog * Corrected typo Fix for empty volumes on test_config Added comment to remind uncomment test case in the future Add more validation Add more validation Add more validation Add to config volumes and remove upper case variable name * Added keyword into tests --------- Co-authored-by: André Marcel Gutiérrez Benítez <[email protected]> * Cherry picked 1.9.0 beta.1 into dev (#1207) * Merge Staging release v1.9.0 beta.1 into main (#1205) * Add max_rc support for module zos_tso_command (#666) * rebuilding 565 * fixing pep8 issue * corrected not in code, added functional test to use maxrc * changing maxrc return codes as indicated * updated copy_rexx to incorporate max_rc * pep8 issue on an if statement * changed test to dump intermediate values temporarily * added max_rc to arg params to get it to pass through * removed extra output on test * Added changelog fragment. * Update 565-zos_tsocommand_maxrc.yml * PARTIAL correction based on reviewer's feedback. Will complete later today. * Partial push: change origrc to orig_rc and added documentation. Added experimental loop for multiline results. Changed error case to continue through the commands even after a failure (?!) * Changes based on review feedback: - rc is actual returned value - origrc/orig_rc removed - in a list of commands, first error (considering max_rc) stops the chain - while processing commands, a list of success/failures are kept for error state info - changed listds to a longer, more complete string in example * updated test case for max_rc to use longer, more complete listds command * Minor pep8 and yamllint changes * Updated string builder to use append and join, for efficiency. * Update changelog fragment to correspond to pull request number Signed-off-by: ddimatos <[email protected]> * removed old fragment Signed-off-by: ddimatos <[email protected]> * Changed output of command-by-command to use max_rc instead of Max RC, for consistency. * clarifying failure message when user hasn't set a max_rc. * corrected date on copyright notice to include current year. * corrected copyright date on test case --------- Signed-off-by: ddimatos <[email protected]> Co-authored-by: Demetri <[email protected]> * added changelog fragment Signed-off-by: ddimatos <[email protected]> * zos_copy forward port a test case for symbols on a volume #739 (#740) * added test case for symbols on a volume Signed-off-by: ddimatos <[email protected]> * Changelog fragment added Signed-off-by: ddimatos <[email protected]> * Update test case with added comments Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * Volume Initialization Module (#654) * Adding ZOS_INIT plugins The module and action for ZOS_Init command, under zos_ickdsf_command. Designed for version 1.3.1, and example given references removed zos_ssh.py. * Create zos_ickdsf_command.rst Tentative documentation. Does not quite list every return, and program may change to work with overall zos core collection. * Update zos_ickdsf_command.py fixed to pass pep8 sanity test. * Update zos_ickdsf_command.py Edited zos_ickdsf_command.py in action folder to pass pep8 style check. * bugfix - undo hard-coded storagegroup param from command passed to mvs_raw Signed-off-by: Ketan Kelkar <[email protected]> * update encoding and licensing info Signed-off-by: Ketan Kelkar <[email protected]> * edit descriptions, leaving in old to verify messaging with dfsms team Signed-off-by: Ketan Kelkar <[email protected]> * remove references to buildix Signed-off-by: Ketan Kelkar <[email protected]> * cleanup examples docstring Signed-off-by: Ketan Kelkar <[email protected]> * add return docstring Signed-off-by: Ketan Kelkar <[email protected]> * add some unit tests Signed-off-by: Ketan Kelkar <[email protected]> * update dict names, some clean up Signed-off-by: Ketan Kelkar <[email protected]> * update interface and docs with cleaner descriptions and define default values and required true/false where applicable Signed-off-by: Ketan Kelkar <[email protected]> * remove init param and bring out sub-options one level Signed-off-by: Ketan Kelkar <[email protected]> * rename module from zos_ickdsf_command to zos_ickdsf_init Signed-off-by: Ketan Kelkar <[email protected]> * remove files referring to zos_ickdsf_command; i forgot to untrack these in the previous commit Signed-off-by: Ketan Kelkar <[email protected]> * remove params from intitial definition of results dict which are not always present, remove unused return params, rename message to msg to match ibm_zos_core and ansible style Signed-off-by: Ketan Kelkar <[email protected]> * add ignore missing gplv3 license warning from sanity testings to existing ignore files Signed-off-by: Ketan Kelkar <[email protected]> * style edits to pass sanity tests Signed-off-by: Ketan Kelkar <[email protected]> * add in-depth task name to first example docstring Signed-off-by: Ketan Kelkar <[email protected]> * add minimal params functional test Signed-off-by: Ketan Kelkar <[email protected]> * convert action plugin to module_util, remove IckdsfCommand and CommandInit class definitions and custom error classes, move convert method to module_util Signed-off-by: Ketan Kelkar <[email protected]> * rename rc param, update func test Signed-off-by: Ketan Kelkar <[email protected]> * add note about disabled verify_offline check Signed-off-by: Ketan Kelkar <[email protected]> * removed volume_address checks which can be handled by ansiblemodule parsing validation or ickdsf itself; changed function signature of convert method to include results dicts so it can pass it to fail_json method in the case of module failure Signed-off-by: Ketan Kelkar <[email protected]> * add invalid volume_address func tests Signed-off-by: Ketan Kelkar <[email protected]> * change param names, organize mvscmd return output Signed-off-by: Ketan Kelkar <[email protected]> * consolidate negative func tests, add negative tests for vtoc_tracks param, start list for postive tests to implement Signed-off-by: Ketan Kelkar <[email protected]> * add func tests for "verify_existing_volid" and "verify_no_data_sets_exist" Signed-off-by: Ketan Kelkar <[email protected]> * add volid positive and negative func tests Signed-off-by: Ketan Kelkar <[email protected]> * add mutual exclusion to no index/sms_managedw with func test, minor edits to comments * add func tests for index param Signed-off-by: Ketan Kelkar <[email protected]> * add func test for vtoc_tracks param Signed-off-by: Ketan Kelkar <[email protected]> * remove 'addr_range', 'volid_prefix' and 'output_html' params; add example with ansible loop to init multiple serial volumes Signed-off-by: Ketan Kelkar <[email protected]> * convert 'content' return param to list for prettier playbook output Signed-off-by: Ketan Kelkar <[email protected]> * add specific examples to docstring Signed-off-by: Ketan Kelkar <[email protected]> * add guard rail test with volser check set to ensure target volume is as expected Signed-off-by: Ketan Kelkar <[email protected]> * switch target test vol to user02, remove existing data sets in initial test Signed-off-by: Ketan Kelkar <[email protected]> * start adding author names to docstring, edits of yaml for sanity test Signed-off-by: Ketan Kelkar <[email protected]> * rename module to zos_volume_init Signed-off-by: Ketan Kelkar <[email protected]> * remove unit test suite which was not kept up to date with code restructure Signed-off-by: Ketan Kelkar <[email protected]> * remove old/outdated .rst file Signed-off-by: Ketan Kelkar <[email protected]> * bring up to speed with v1.5.0-beta.1 which is currently more recent than dev Signed-off-by: Ketan Kelkar <[email protected]> * add sanity test 2.15 file Signed-off-by: Ketan Kelkar <[email protected]> * clean up trailing empty lines/space chars Signed-off-by: Ketan Kelkar <[email protected]> * more pep8 style Signed-off-by: Ketan Kelkar <[email protected]> * pull in more changes from latest dev branch Signed-off-by: Ketan Kelkar <[email protected]> * tweak tests/sanity/ignore-2.10.txt file Signed-off-by: Ketan Kelkar <[email protected]> * rename volume_address to address, rename verify_no_data_sets_exist to verify_volume_empty, rename verify_existing_volid to verify_volid, rename vtoc_tracks to vtoc_size, rename return param command to cmd, make suggested doc changes, switch off check_mode Signed-off-by: Ketan Kelkar <[email protected]> * resolve pep8 line too long issue Signed-off-by: Ketan Kelkar <[email protected]> * add year to copyright, add gh user name to author, restyle true/false with code rather than italics, remove backslashes in docstring Signed-off-by: Ketan Kelkar <[email protected]> * add changelog fragment Signed-off-by: Ketan Kelkar <[email protected]> * update zos_fetch test case to create data set instead of using one that gets wiped away by zos_volume_init test cases Signed-off-by: Ketan Kelkar <[email protected]> * address PR comments including pep8 styling, docstring changes including add seealso section, add details around authorized usage of ickdsf, some light wordsmithing, and remove cmd from return structure Signed-off-by: Ketan Kelkar <[email protected]> * add backticks to other special chars in docs for consistency Signed-off-by: Ketan Kelkar <[email protected]> * on more formatting tweak to national chars in docstring Signed-off-by: Ketan Kelkar <[email protected]> * add new param to support tmp_hlq Signed-off-by: Ketan Kelkar <[email protected]> * extend tmphlq binding to sysprint(*), disable verbose mode for mvscmd call Signed-off-by: Ketan Kelkar <[email protected]> * remove references to betterargparser - it cannot be used in its current state as it is too restrictive on volume serial and qualifier args Signed-off-by: Ketan Kelkar <[email protected]> * remove soft language ie beware, please; reduce line lengths, fix a spelling error Signed-off-by: Ketan Kelkar <[email protected]> * reorganize test case code for more logical grouping and un-nesting from a for loop, also update copyright year that was missed Signed-off-by: Ketan Kelkar <[email protected]> * update display command check to only check particular lines instead of entire output in test_volid_address_assigned_correctly which would always be positive when tested against the entire output Signed-off-by: Ketan Kelkar <[email protected]> --------- Signed-off-by: Ketan Kelkar <[email protected]> Co-authored-by: trevor-glassey <[email protected]> * Ported bugfixes for #664 and #678 from 1.5.0 (#743) * Ported bugfixes for #664 and #678 * Updated file normalization for sequential datasets * Fixed encoding when a remote source is used * Added encoding normalization for record length (#664) This is a port and tweak from the normalization found in the L2 support branch. Now the normalization applies for both local and remote source files. There is still work left to validate how this behaves when copying to partitioned datasets, and see if the normalization needs to handle directories as well. * Refactored normalization for USS files * Updated line endings normalization in PDSEs * Updated create_temp_with_lf_endings * Added tests for line endings normalization * Added changelog fragment * Updated changelog fragment * Updated copyright information * Added comments to record length tests * Added more context to the record length normalization * Add force (disp=shr) option to zos_lineinfile and update zos_blockinfile with the same locking test case. (#731) * Add DISP=SHR by function force to the user * Add helper function for force cases only for EOF inserts * Test cases added * Just to check in the change case * All test cases for force in zos_lineinfile working properly * Test cases for force blockinfile * Fixes for style of code * One identation error * One identation error * One identation error * Documentation error * All test cases for line infile and block infile * Comments * Change the stdout to assert with expected of ds * Error of test case * Fragment added * Solve typo errors * Update to remove uncessary comment Signed-off-by: ddimatos <[email protected]> * Update changelog fragment Signed-off-by: ddimatos <[email protected]> * Update module with force comments Signed-off-by: ddimatos <[email protected]> * Solve some test problems * Copyright year * Copyright year * Add cases for other ecodes * Add test for all encodings * Cover all encodes test cases with force * Blockinfile force added for other encodes and DS types --------- Signed-off-by: ddimatos <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> Co-authored-by: ddimatos <[email protected]> * remove duplicate function (#753) * Update branch production branch Main with release v1.5.0 content (#756) (#758) * Bug fix to correct job log returining and other edge cases (#688) * Update zos_job_submit to handle some edge cases and return the job log nearly always * Linting correction * Add changelog fragement for pr 683 * Clean up comments in code * Update restructured text for modules and changelog fragment * Add support to check for security exception to job submit module * Add additonal logic for jobs that use typerun=scan * Update chnagelog fragment * Correct run on sentence --------- * Added additional `D SYMBOLS` example to zos_operator documentation (#729) * Update zos_operator with an additional example * Added change fragment --------- * Ported bugfixes for #664 and #678 * Updated file normalization for sequential datasets * Fixed encoding when a remote source is used * Added encoding normalization for record length (#664) This is a port and tweak from the normalization found in the L2 support branch. Now the normalization applies for both local and remote source files. There is still work left to validate how this behaves when copying to partitioned datasets, and see if the normalization needs to handle directories as well. * Refactored normalization for USS files * Updated line endings normalization in PDSEs * Updated create_temp_with_lf_endings * Added tests for line endings normalization * Added changelog fragment * Add copy lib member test case * Corrected changelog fragment * Add conflict resolution * Update 641-copy-loadlib-member.yml * zos_copy forward port a test case for symbols on a volume (#739) * Add a test case for symbols using an existing volume on our test system * Add changelog fragment * Update 739-zos_copy-volume-symbol-test.yml Update description to use symbols overs special chars. * Update test case with added comments --------- * bring in updates to zos_gather_facts RETURN docstring (#744) * Solve problem 619 about set mode on dest file (#746) * Solve problem 619 about set mode on dest file * Add fragment of 746 PR --------- * Merge release tasks for v1.5.0 into release branch (#752) * Updated metadata * Updated copyright information * Updated copyright in README * Generated changelog * Added previous versions to changelog * Changed a minor_change fragment to bugfix * Updated release notes * Update dependency finder to allow for all tests minus skip tests * Update release notes and changelog with full date formats --------- * remove changelog fragments no longer needed (#754) --------- Signed-off-by: ddimatos <[email protected]> Signed-off-by: Ketan Kelkar <[email protected]> Co-authored-by: Ivan Moreno <[email protected]> Co-authored-by: Fernando Flores <[email protected]> Co-authored-by: Rich Parker <[email protected]> Co-authored-by: ketankelkar <[email protected]> Co-authored-by: André Marcel Gutiérrez Benítez <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> * Merge master to dev for 1.6.0 beta.1 (#763) * Update branch production branch Main with release v1.5.0 content (#756) * Bug fix to correct job log returining and other edge cases (#688) * Update zos_job_submit to handle some edge cases and return the job log nearly always Signed-off-by: ddimatos <[email protected]> * Linting correction Signed-off-by: ddimatos <[email protected]> * Add changelog fragement for pr 683 Signed-off-by: ddimatos <[email protected]> * Clean up comments in code Signed-off-by: ddimatos <[email protected]> * Update restructured text for modules and changelog fragment Signed-off-by: ddimatos <[email protected]> * Add support to check for security exception to job submit module Signed-off-by: ddimatos <[email protected]> * Add additonal logic for jobs that use typerun=scan Signed-off-by: ddimatos <[email protected]> * Update chnagelog fragment Signed-off-by: ddimatos <[email protected]> * Correct run on sentence Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * Added additional `D SYMBOLS` example to zos_operator documentation (#729) * Update zos_operator with an additional example Signed-off-by: ddimatos <[email protected]> * Added change fragment Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * Ported bugfixes for #664 and #678 * Updated file normalization for sequential datasets * Fixed encoding when a remote source is used * Added encoding normalization for record length (#664) This is a port and tweak from the normalization found in the L2 support branch. Now the normalization applies for both local and remote source files. There is still work left to validate how this behaves when copying to partitioned datasets, and see if the normalization needs to handle directories as well. * Refactored normalization for USS files * Updated line endings normalization in PDSEs * Updated create_temp_with_lf_endings * Added tests for line endings normalization * Added changelog fragment * Add copy lib member test case * Corrected changelog fragment * Add conflict resolution * Update 641-copy-loadlib-member.yml * zos_copy forward port a test case for symbols on a volume (#739) * Add a test case for symbols using an existing volume on our test system Signed-off-by: ddimatos <[email protected]> * Add changelog fragment Signed-off-by: ddimatos <[email protected]> * Update 739-zos_copy-volume-symbol-test.yml Update description to use symbols overs special chars. * Update test case with added comments Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * bring in updates to zos_gather_facts RETURN docstring (#744) Signed-off-by: Ketan Kelkar <[email protected]> * Solve problem 619 about set mode on dest file (#746) * Solve problem 619 about set mode on dest file * Add fragment of 746 PR --------- Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> * Merge release tasks for v1.5.0 into release branch (#752) * Updated metadata * Updated copyright information * Updated copyright in README * Generated changelog * Added previous versions to changelog * Changed a minor_change fragment to bugfix * Updated release notes * Update dependency finder to allow for all tests minus skip tests Signed-off-by: ddimatos <[email protected]> * Update release notes and changelog with full date formats Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> Co-authored-by: ddimatos <[email protected]> * remove changelog fragments no longer needed (#754) Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> Signed-off-by: Ketan Kelkar <[email protected]> Co-authored-by: Ivan Moreno <[email protected]> Co-authored-by: Fernando Flores <[email protected]> Co-authored-by: Rich Parker <[email protected]> Co-authored-by: ketankelkar <[email protected]> Co-authored-by: André Marcel Gutiérrez Benítez <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> * v1.6.0-beta.1 release (#759) * Added tagging of converted files * Updated tests for zos_encode * Added restoration of PDS/PDSE members when module fails zos_copy can now track which members got overwritten or newly added to a partitioned data set, and restore them accordingly. This commit includes a refactorization of the copy_to_pdse method to simplify the restoration work. * Fixed cleanup of dest when module fails * Removed exception used for debugging * Added pytest markers * solved pep8 issue * Added more information to error when restoration fails * Update make file with new features to manage the nodes (#563) * Update make file with new features to manage the nodes Signed-off-by: ddimatos <[email protected]> * Correct typo Signed-off-by: ddimatos <[email protected]> * updated makefile to allow for no password in the clear and added a new host Signed-off-by: ddimatos <[email protected]> Signed-off-by: ddimatos <[email protected]> * Fix a bug that failed to copy the cert to the managed node (#577) Signed-off-by: ddimatos <[email protected]> Signed-off-by: ddimatos <[email protected]> * Added apropiate error message in zos_lineinfile when src is not found * Better error message * Added fragment for changelog * Update git issue slection field (#593) * Update git issue slection field * Added some additional future versions * Added rule to ignore python 2.7 compile not supporting f strings * Corrected rule in ignore file * Update 584-zos_lineinfile-error-message.yml * Added missing fragments for issues 309 and 408 * update make file and related artifacts with recent zVM changes (#598) Signed-off-by: ddimatos <[email protected]> Signed-off-by: ddimatos <[email protected]> * Expand what is ingored for venv to all venv's (#613) Signed-off-by: ddimatos <[email protected]> Signed-off-by: ddimatos <[email protected]> * Ansible-core versions with updated ignore file pass (#615) * Validated that ansible-core versions with updated ignore file pass locally Signed-off-by: ddimatos <[email protected]> * remove redundant entry on last line Signed-off-by: ddimatos <[email protected]> * remove redundant entry on last line Signed-off-by: ddimatos <[email protected]> Signed-off-by: ddimatos <[email protected]> * Update make file to read exported var VENV else default to 'venv' (#614) * Update make file to read exported var VENV else default to 'venv' Signed-off-by: ddimatos <[email protected]> * Correct the default from defaultValue to 'venv' Signed-off-by: ddimatos <[email protected]> * Bugfix/558/zos copy backup dev (#609) * Create emergency backup only if force is set to False and dest exists * Added Changelog fragment * Updated imports ansible.module_utils._text to ansible.module_utils.common.text.converters (#602) * Updated import in zos_fetch * Updated import in zos_job_submit * Updated import in module_utils/data_set * Updated import in module_utils/System * Updated import in zos_copy * Updated import in zos_fetch * Added changelog fragment * Update enhancement-518-text-converter-import.yml * Updates the makefile and related scripts for the latest mounts (#628) * Update makefile coments and use --ignore for pytest Signed-off-by: ddimatos <[email protected]> * lexicographical order targets Signed-off-by: ddimatos <[email protected]> * Update makefile and artifacts to support new mounts Signed-off-by: ddimatos <[email protected]> * Removing encrypted versions of the scripts, no longer senstive content Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * update profile created for mount points Signed-off-by: ddimatos <[email protected]> * Correct f-string usage to remain 2.7 compatible (#659) * Correct f-string usage to remain 2.7 compatible Signed-off-by: ddimatos <[email protected]> * Update changelog fragments Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * Updated shell scripts for development tooling Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Update collab template Signed-off-by: ddimatos <[email protected]> * Update collab template Signed-off-by: ddimatos <[email protected]> * Update collab template Signed-off-by: ddimatos <[email protected]> * Template updates Signed-off-by: ddimatos <[email protected]> * Template updates Signed-off-by: ddimatos <[email protected]> * add udpated checkbox to collab template Signed-off-by: ddimatos <[email protected]> * add udpated checkbox to collab template Signed-off-by: ddimatos <[email protected]> * add udpated checkbox to collab template Signed-off-by: ddimatos <[email protected]> * add udpated checkbox to collab template Signed-off-by: ddimatos <[email protected]> * add udpated checkbox to collab template Signed-off-by: ddimatos <[email protected]> * add udpated checkbox to collab template Signed-off-by: ddimatos <[email protected]> * changed zos_job_query to allow multi/embedded wildcard job_values. job.py/_get_job_status now uses fnmatch to test for wildcarded job_names. added test looking for a wildcard job name. added basic changelog text as 'enhancement'. * expanded wildcard support to job_id as well as job_name corrected error-handling issue in query routine playbook tests complete * cleaned up pep8 issues * Bug fix to correct job log returining and other edge cases (#683) * Update zos_job_submit to handle some edge cases and return the job log nearly always Signed-off-by: ddimatos <[email protected]> * Linting correction Signed-off-by: ddimatos <[email protected]> * Add changelog fragement for pr 683 Signed-off-by: ddimatos <[email protected]> * Clean up comments in code Signed-off-by: ddimatos <[email protected]> * Update restructured text for modules and changelog fragment Signed-off-by: ddimatos <[email protected]> * Add support to check for security exception to job submit module Signed-off-by: ddimatos <[email protected]> * Add additonal logic for jobs that use typerun=scan Signed-off-by: ddimatos <[email protected]> * Update chnagelog fragment Signed-off-by: ddimatos <[email protected]> * Update zos_job_submit.py Grammar change and correction. --------- Signed-off-by: ddimatos <[email protected]> * Added uss_tag_encoding function * Fixing linter issues * removed extraneous comment on query, eliminated unused variable * responding to reviewer comments * Expanded query tests to run a hello jcl file to make sure we are searching for a job id that exists. * Expanded documentation in code to highlight asterisk availability. Added examples showing multi-asterisk search. * Corrected 2 documentation errors * Change to documentation text (indent on multi line string?) * Still trying to get documentation to pass * Looks like '---' was killing documentation block. * Update zos_blockinfile with complex examples (#727) * Update zos_blockinfile with complex examples Signed-off-by: ddimatos <[email protected]> * Add changelog fragement Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * Added additional D SYMBOLS example to zos_operator documentation (#730) * Update zos_operator with an additional example Signed-off-by: ddimatos <[email protected]> * Added changelog fragment Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * zos_gather_facts - add sample output to RETURN docstring (#722) * zos_gather_facts - add sample output to RETURN docstring Signed-off-by: Ketan Kelkar <[email protected]> * add changelog fragment Signed-off-by: Ketan Kelkar <[email protected]> * zos_gather_facts RETURN docstring - add sample sysplex_name and lpar_name values Signed-off-by: Ketan Kelkar <[email protected]> * Update generated module doc Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: Ketan Kelkar <[email protected]> Signed-off-by: ddimatos <[email protected]> Co-authored-by: ddimatos <[email protected]> * 574find (#668) * change to allow find loop to continue when one particular data set element is not found This has been validated with a zos-check-find.yaml playbook * added functional test that includes non-existant pds entry, which should be skipped over * added changelog fragment. * zos_blockinfile , can quotes in content can be supported (#680) * Verify coomand of ZOAU support the doble quotes and get better output of message * Verify coomand of ZOAU support the doble quotes and get better output of message * Restore to the one tyme function solving TypeError * Test about cases with quotes supported * Solve comments * Comments in the changelog * Adjust test for working accord the text * A needed space * All in structured * Comments solved * Better order --------- Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> Co-authored-by: Demetri <[email protected]> * zos_copy mode is applied to the destination directory, a deviation from the communtiy module behavior. (#723) * Verify coomand of ZOAU support the doble quotes and get better output of message * Verify coomand of ZOAU support the doble quotes and get better output of message * Restore to the one tyme function solving TypeError * Test about cases with quotes supported * Solve comments * Comments in the changelog * Adjust test for working accord the text * Solve the dest functional mode set for the applied to destination directory * Identation and spaces * To work well * To work well * To work well * To work well * Changelogs added * Solved the fragment test and separte the cases --------- Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> * corrected job test case that wanted to extract job id. * changed call to zos_job_query in the functional test. * zos_data_set - add force parameter to enable member delete via disp shr (#718) * add force parameter to enable member delete via disp shr Signed-off-by: Ketan Kelkar <[email protected]> * update link to PR instead of issue Signed-off-by: Ketan Kelkar <[email protected]> * fix minor mistake in func test Signed-off-by: Ketan Kelkar <[email protected]> * update DOCstring for missed items highlighted in PR review Signed-off-by: Ketan Kelkar <[email protected]> * update copyright years in data set module util Signed-off-by: Ketan Kelkar <[email protected]> --------- Signed-off-by: Ketan Kelkar <[email protected]> * Update changelog fragment Signed-off-by: ddimatos <[email protected]> * Update to doc and examples Signed-off-by: ddimatos <[email protected]> * Update to doc and examples Signed-off-by: ddimatos <[email protected]> * Update to doc and examples Signed-off-by: ddimatos <[email protected]> * update doc, rst Signed-off-by: ddimatos <[email protected]> * Update doc and examples Signed-off-by: ddimatos <[email protected]> * Added handler for job not found edge cases (None not iterable errors) * corrected pep8 issue (bad indent) * removed tracking text from error/not found messages. * Update zos_job_query.py * Add and automate a load lib test case for module zos_copy (#640) * Modified if statement * Added changelog fragment * Corrected statements Corrected PR in changelog fix lint issue * Adding test case on the work * Added assertion to loadlib test Changed cobol src Added newlines * Correcting cobol src * Removed unnecessary comments * Removed deprint statements for debug * Update 601-copy-loadlib-member.yml * Reduce space primary * Make sure cobol is executable * corrected name * Corrected names * Adding debug statements * modified name in link step * Changing copy name * Removed print statements for debug * Removed previous changelog * Removed unused fragment * Removed test case * Add max_rc support for module zos_tso_command (#666) * rebuilding 565 * fixing pep8 issue * corrected not in code, added functional test to use maxrc * changing maxrc return codes as indicated * updated copy_rexx to incorporate max_rc * pep8 issue on an if statement * changed test to dump intermediate values temporarily * added max_rc to arg params to get it to pass through * removed extra output on test * Added changelog fragment. * Update 565-zos_tsocommand_maxrc.yml * PARTIAL correction based on reviewer's feedback. Will complete later today. * Partial push: change origrc to orig_rc and added documentation. Added experimental loop for multiline results. Changed error case to continue through the commands even after a failure (?!) * Changes based on review feedback: - rc is actual returned value - origrc/orig_rc removed - in a list of commands, first error (considering max_rc) stops the chain - while processing commands, a list of success/failures are kept for error state info - changed listds to a longer, more complete string in example * updated test case for max_rc to use longer, more complete listds command * Minor pep8 and yamllint changes * Updated string builder to use append and join, for efficiency. * Update changelog fragment to correspond to pull request number Signed-off-by: ddimatos <[email protected]> * removed old fragment Signed-off-by: ddimatos <[email protected]> * Changed output of command-by-command to use max_rc instead of Max RC, for consistency. * clarifying failure message when user hasn't set a max_rc. * corrected date on copyright notice to include current year. * corrected copyright date on test case --------- Signed-off-by: ddimatos <[email protected]> Co-authored-by: Demetri <[email protected]> * added changelog fragment Signed-off-by: ddimatos <[email protected]> * zos_copy forward port a test case for symbols on a volume #739 (#740) * added test case for symbols on a volume Signed-off-by: ddimatos <[email protected]> * Changelog fragment added Signed-off-by: ddimatos <[email protected]> * Update test case with added comments Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * Volume Initialization Module (#654) * Adding ZOS_INIT plugins The module and action for ZOS_Init command, under zos_ickdsf_command. Designed for version 1.3.1, and example given references removed zos_ssh.py. * Create zos_ickdsf_command.rst Tentative documentation. Does not quite list every return, and program may change to work with overall zos core collection. * Update zos_ickdsf_command.py fixed to pass pep8 sanity test. * Update zos_ickdsf_command.py Edited zos_ickdsf_command.py in action folder to pass pep8 style check. * bugfix - undo hard-coded storagegroup param from command passed to mvs_raw Signed-off-by: Ketan Kelkar <[email protected]> * update encoding and licensing info Signed-off-by: Ketan Kelkar <[email protected]> * edit descriptions, leaving in old to verify messaging with dfsms team Signed-off-by: Ketan Kelkar <[email protected]> * remove references to buildix Signed-off-by: Ketan Kelkar <[email protected]> * cleanup examples docstring Signed-off-by: Ketan Kelkar <[email protected]> * add return docstring Signed-off-by: Ketan Kelkar <[email protected]> * add some unit tests Signed-off-by: Ketan Kelkar <[email protected]> * update dict names, some clean up Signed-off-by: Ketan Kelkar <[email protected]> * update interface and docs with cleaner descriptions and define default values and required true/false where applicable Signed-off-by: Ketan Kelkar <[email protected]> * remove init param and bring out sub-options one level Signed-off-by: Ketan Kelkar <[email protected]> * rename module from zos_ickdsf_command to zos_ickdsf_init Signed-off-by: Ketan Kelkar <[email protected]> * remove files referring to zos_ickdsf_command; i forgot to untrack these in the previous commit Signed-off-by: Ketan Kelkar <[email protected]> * remove params from intitial definition of results dict which are not always present, remove unused return params, rename message to msg to match ibm_zos_core and ansible style Signed-off-by: Ketan Kelkar <[email protected]> * add ignore missing gplv3 license warning from sanity testings to existing ignore files Signed-off-by: Ketan Kelkar <[email protected]> * style edits to pass sanity tests Signed-off-by: Ketan Kelkar <[email protected]> * add in-depth task name to first example docstring Signed-off-by: Ketan Kelkar <[email protected]> * add minimal params functional test Signed-off-by: Ketan Kelkar <[email protected]> * convert action plugin to module_util, remove IckdsfCommand and CommandInit class definitions and custom error classes, move convert method to module_util Signed-off-by: Ketan Kelkar <[email protected]> * rename rc param, update func test Signed-off-by: Ketan Kelkar <[email protected]> * add note about disabled verify_offline check Signed-off-by: Ketan Kelkar <[email protected]> * removed volume_address checks which can be handled by ansiblemodule parsing validation or ickdsf itself; changed function signature of convert method to include results dicts so it can pass it to fail_json method in the case of module failure Signed-off-by: Ketan Kelkar <[email protected]> * add invalid volume_address func tests Signed-off-by: Ketan Kelkar <[email protected]> * change param names, organize mvscmd return output Signed-off-by: Ketan Kelkar <[email protected]> * consolidate negative func tests, add negative tests for vtoc_tracks param, start list for postive tests to implement Signed-off-by: Ketan Kelkar <[email protected]> * add func tests for "verify_existing_volid" and "verify_no_data_sets_exist" Signed-off-by: Ketan Kelkar <[email protected]> * add volid positive and negative func tests Signed-off-by: Ketan Kelkar <[email protected]> * add mutual exclusion to no index/sms_managedw with func test, minor edits to comments * add func tests for index param Signed-off-by: Ketan Kelkar <[email protected]> * add func test for vtoc_tracks param Signed-off-by: Ketan Kelkar <[email protected]> * remove 'addr_range', 'volid_prefix' and 'output_html' params; add example with ansible loop to init multiple serial volumes Signed-off-by: Ketan Kelkar <[email protected]> * convert 'content' return param to list for prettier playbook output Signed-off-by: Ketan Kelkar <[email protected]> * add specific examples to docstring Signed-off-by: Ketan Kelkar <[email protected]> * add guard rail test with volser check set to ensure target volume is as expected Signed-off-by: Ketan Kelkar <[email protected]> * switch target test vol to user02, remove existing data sets in initial test Signed-off-by: Ketan Kelkar <[email protected]> * start adding author names to docstring, edits of yaml for sanity test Signed-off-by: Ketan Kelkar <[email protected]> * rename module to zos_volume_init Signed-off-by: Ketan Kelkar <[email protected]> * remove unit test suite which was not kept up to date with code restructure Signed-off-by: Ketan Kelkar <[email protected]> * remove old/outdated .rst file Signed-off-by: Ketan Kelkar <[email protected]> * bring up to speed with v1.5.0-beta.1 which is currently more recent than dev Signed-off-by: Ketan Kelkar <[email protected]> * add sanity test 2.15 file Signed-off-by: Ketan Kelkar <[email protected]> * clean up trailing empty lines/space chars Signed-off-by: Ketan Kelkar <[email protected]> * more pep8 style Signed-off-by: Ketan Kelkar <[email protected]> * pull in more changes from latest dev branch Signed-off-by: Ketan Kelkar <[email protected]> * tweak tests/sanity/ignore-2.10.txt file Signed-off-by: Ketan Kelkar <[email protected]> * rename volume_address to address, rename verify_no_data_sets_exist to verify_volume_empty, rename verify_existing_volid to verify_volid, rename vtoc_tracks to vtoc_size, rename return param command to cmd, make suggested doc changes, switch off check_mode Signed-off-by: Ketan Kelkar <[email protected]> * resolve pep8 line too long issue Signed-off-by: Ketan Kelkar <[email protected]> * add year to copyright, add gh user name to author, restyle true/false with code rather than italics, remove backslashes in docstring Signed-off-by: Ketan Kelkar <[email protected]> * add changelog fragment Signed-off-by: Ketan Kelkar <[email protected]> * update zos_fetch test case to create data set instead of using one that gets wiped away by zos_volume_init test cases Signed-off-by: Ketan Kelkar <[email protected]> * address PR comments including pep8 styling, docstring changes including add seealso section, add details around authorized usage of ickdsf, some light wordsmithing, and remove cmd from return structure Signed-off-by: Ketan Kelkar <[email protected]> * add backticks to other special chars in docs for consistency Signed-off-by: Ketan Kelkar <[email protected]> * on more formatting tweak to national chars in docstring Signed-off-by: Ketan Kelkar <[email protected]> * add new param to support tmp_hlq Signed-off-by: Ketan Kelkar <[email protected]> * extend tmphlq binding to sysprint(*), disable verbose mode for mvscmd call Signed-off-by: Ketan Kelkar <[email protected]> * remove references to betterargparser - it cannot be used in its current state as it is too restrictive on volume serial and qualifier args Signed-off-by: Ketan Kelkar <[email protected]> * remove soft language ie beware, please; reduce line lengths, fix a spelling error Signed-off-by: Ketan Kelkar <[email protected]> * reorganize test case code for more logical grouping and un-nesting from a for loop, also update copyright year that was missed Signed-off-by: Ketan Kelkar <[email protected]> * update display command check to only check particular lines instead of entire output in test_volid_address_assigned_correctly which would always be positive when tested against the entire output Signed-off-by: Ketan Kelkar <[email protected]> --------- Signed-off-by: Ketan Kelkar <[email protected]> Co-authored-by: trevor-glassey <[email protected]> * Ported bugfixes for #664 and #678 from 1.5.0 (#743) * Ported bugfixes for #664 and #678 * Updated file normalization for sequential datasets * Fixed encoding when a remote source is used * Added encoding normalization for record length (#664) This is a port and tweak from the normalization found in the L2 support branch. Now the normalization applies for both local and remote source files. There is still work left to validate how this behaves when copying to partitioned datasets, and see if the normalization needs to handle directories as well. * Refactored normalization for USS files * Updated line endings normalization in PDSEs * Updated create_temp_with_lf_endings * Added tests for line endings normalization * Added changelog fragment * Updated changelog fragment * Updated copyright information * Added comments to record length tests * Added more context to the record length normalization * Add force (disp=shr) option to zos_lineinfile and update zos_blockinfile with the same locking test case. (#731) * Add DISP=SHR by function force to the user * Add helper function for force cases only for EOF inserts * Test cases added * Just to check in the change case * All test cases for force in zos_lineinfile working properly * Test cases for force blockinfile * Fixes for style of code * One identation error * One identation error * One identation error * Documentation error * All test cases for line infile and block infile * Comments * Change the stdout to assert with expected of ds * Error of test case * Fragment added * Solve typo errors * Update to remove uncessary comment Signed-off-by: ddimatos <[email protected]> * Update changelog fragment Signed-off-by: ddimatos <[email protected]> * Update module with force comments Signed-off-by: ddimatos <[email protected]> * Solve some test problems * Copyright year * Copyright year * Add cases for other ecodes * Add test for all encodings * Cover all encodes test cases with force * Blockinfile force added for other encodes and DS types --------- Signed-off-by: ddimatos <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> Co-authored-by: ddimatos <[email protected]> * remove duplicate function (#753) * Update branch production branch Main with release v1.5.0 content (#756) (#758) * Bug fix to correct job log returining and other edge cases (#688) * Update zos_job_submit to handle some edge cases and return the job log nearly always * Linting correction * Add changelog fragement for pr 683 * Clean up comments in code * Update restructured text for modules and changelog fragment * Add support to check for security exception to job submit module * Add additonal logic for jobs that use typerun=scan * Update chnagelog fragment * Correct run on sentence --------- * Added additional `D SYMBOLS` example to zos_operator documentation (#729) * Update zos_operator with an additional example * Added change fragment --------- * Ported bugfixes for #664 and #678 * Updated file normalization for sequential datasets * Fixed encoding when a remote source is used * Added encoding normalization for record length (#664) This is a port and tweak from the normalization found in the L2 support branch. Now the normalization applies for both local and remote source files. There is still work left to validate how this behaves when copying to partitioned datasets, and see if the normalization needs to handle directories as well. * Refactored normalization for USS files * Updated line endings normalization in PDSEs * Updated create_temp_with_lf_endings * Added tests for line endings normalization * Added changelog fragment * Add copy lib member test case * Corrected changelog fragment * Add conflict resolution * Update 641-copy-loadlib-member.yml * zos_copy forward port a test case for symbols on a volume (#739) * Add a test case for symbols using an existing volume on our test system * Add changelog fragment * Update 739-zos_copy-volume-symbol-test.yml Update description to use symbols overs special chars. * Update test case with added comments --------- * bring in updates to zos_gather_facts RETURN docstring (#744) * Solve problem 619 about set mode on dest file (#746) * Solve problem 619 about set mode on dest file * Add fragment of 746 PR --------- * Merge release tasks for v1.5.0 into release branch (#752) * Updated metadata * Updated copyright information * Updated copyright in README * Generated changelog * Added previous versions to changelog * Changed a minor_change fragment to bugfix * Updated release notes * Update dependency finder to allow for all tests minus skip tests * Update release notes and changelog with full date formats --------- * remove changelog fragments no longer needed (#754) --------- Signed-off-by: ddimatos <[email protected]> Signed-off-by: Ketan Kelkar <[email protected]> Co-authored-by: Ivan Moreno <[email protected]> Co-authored-by: Fernando Flores <[email protected]> Co-authored-by: Rich Parker <[email protected]> Co-authored-by: ketankelkar <[email protected]> Co-authored-by: André Marcel Gutiérrez Benítez <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> * update galaxy and meta/ files Signed-off-by: Ketan Kelkar <[email protected]> * update copyright years Signed-off-by: Ketan Kelkar <[email protected]> * update rst doc files Signed-off-by: Ketan Kelkar <[email protected]> * add 1.6.0-beta.1 release summary fragment Signed-off-by: Ketan Kelkar <[email protected]> * generate changelog Signed-off-by: Ketan Kelkar <[email protected]> * add release notes Signed-off-by: Ketan Kelkar <[email protected]> * add additional stylizing Signed-off-by: Ketan Kelkar <[email protected]> * Delete fragements once changelog is generated Signed-off-by: ddimatos <[email protected]> * update stylizing around *none* in zos_volume_init docs Signed-off-by: Ketan Kelkar <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> Signed-off-by: Ketan Kelkar <[email protected]> Co-authored-by: Ivan Moreno <[email protected]> Co-authored-by: Oscar Fernando Flores Garcia <[email protected]> Co-authored-by: Demetri <[email protected]> Co-authored-by: Rich Parker <[email protected]> Co-authored-by: André Marcel Gutiérrez Benítez <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> Co-authored-by: trevor-glassey <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> * Update ibm_zos_core_meta.yml --------- Signed-off-by: ddimatos <[email protected]> Signed-off-by: Ketan Kelkar <[email protected]> Co-authored-by: Ivan Moreno <[email protected]> Co-authored-by: Fernando Flores <[email protected]> Co-authored-by: Rich Parker <[email protected]> Co-authored-by: ketankelkar <[email protected]> Co-authored-by: André Marcel Gutiérrez Benítez <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> Co-authored-by: trevor-glassey <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> * Bugfix/619/mode set for files applied test case (#757) * Add test case for copy dest file * Add comments * Add test for folders * Adjust spaces * Changes for ensure consistency for all tests * Changes of name and clean creations --------- Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> * Bugfix/381/failed when the job name was null or not found (#747) * Add the verbose for failed when job name was null or not found * Adjust message for what we can get * Whitespaces move * Add code from dev * Ecode utility as is in dev * Year for copyright * Case for having both the jod_id and job_name * Ecode utils functions not in my branch * Add final line ecode * Add fragment * Delete encode function two times, adjust job message and change the fragment * Change variable name for one more descriptive * Restore encode and change one word * Encode * bugfixes * Set up as dev * Better fragment --------- Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> Co-authored-by: Fernando Flores <[email protected]> * Bugfix/660/zos operator reported failure caused by unrelated error response messages (#762) * Add options * Add transparency on the response and test cases * Solve spaces * Add validation to append * Fragment Added * Adjust fail_json on non_zero response * Identation mistakes solved * Solve last idenation problem * Replace prior tooling (makefile) that aidded the development workflow with a new 'ac' command. (#766) * Make file mount script helper Signed-off-by: ddimatos <[email protected]> * Comments to mount script Signed-off-by: ddimatos <[email protected]> * Staged updated scripts for makefile usage Signed-off-by: ddimatos <[email protected]> * Update mount scripts for use with makefile Signed-off-by: ddimatos <[email protected]> * updates to correct mounts and add function to mounts-datasets Signed-off-by: ddimatos <[email protected]> * adding completed new ac command files for development Signed-off-by: ddimatos <[email protected]> * update ignore to more specific with venv Signed-off-by: ddimatos <[email protected]> * Correcting ignore to allow for venv.sh Signed-off-by: ddimatos <[email protected]> * moved logic that checks for info.env to venv.sh Signed-off-by: ddimatos <[email protected]> * Adding changelog fragment Signed-off-by: ddimatos <[email protected]> * Fix a path issue when calling venv.sh Signed-off-by: ddimatos <[email protected]> * Fixes issue not being able to run all tests, fixes issue with content being written to collections folder Signed-off-by: ddimatos <[email protected]> * Support zSH and update scp to fall back to legacy scp protocal Signed-off-by: ddimatos <[email protected]> * Update ac with password usage Signed-off-by: ddimatos <[email protected]> * Update ac with password usage Signed-off-by: ddimatos <[email protected]> * Fix incorrect message and remove the cd's before and after ac-test Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * 347 new query fields (#778) * changing job.py to return 7 more fields, and for zos_job_query to pass them through * corrected testing to pull all new values through this assumes zoau 1.2.3 and z/OS at least 2.4 need to test older zoau to make sure this will still work * Added zoau version testing import to job.py so it won't reach for non-existent members. * pep8 and lint required changes * changed test to see if it will pass unit testing * Modified test_zos_data_set_func to skip HFS test if zOS > 02.04 * changed OS test for hfs usage * corrected usage of 'hosts'... removed the definition in prior edit. * changing OS version checker * corrected string extraction for OS version checker * added delete shell to 196/197 (finally of cat/uncat test) removed success message from 830 (version test logic) * removed the mvscmdauth call, as it coincides with some new test failures. * added changed=false back into testing of job_query * correction of zos->zoau name in comments. * Missing fragment in PR 778 New query fields (#780) * added fragment for pr 778 * Added changelog fragment query new fields Added changelog fragment query new fields * Update 778-query-new-fields.yml * Update docs with ansible/ansible-core version, AAP and fix the dated git issue templates (#771) * Doc vesion updates Signed-off-by: ddimatos <[email protected]> * Repository template updates and future proofing Signed-off-by: ddimatos <[email protected]> * Changelog fragment added Signed-off-by: ddimatos <[email protected]> * Formatting corrections for release notes Signed-off-by: ddimatos <[email protected]> * Upate issue templates with newer version of software Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * Update ac command supporting files (#789) * Update ac command supporting files Signed-off-by: ddimatos <[email protected]> * Add changelog fragment Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * Update zos_data_set module member description Signed-off-by: ddimatos <[email protected]> * Add recently changed module doc from prior commits Signed-off-by: ddimatos <[email protected]> * Add changelog fragment Signed-off-by: ddimatos <[email protected]> * Adding fix for uncataloged vsam and non-vsam data sets Signed-off-by: ddimatos <[email protected]> * Encode files recursively and test case for keep behavior. (#772) * Bring the jinja2 solution to dev and add test case * Add fragment * Solve problem z/OS 2.5 HFS * Declaration error solve * Need to check the validation with HFS * Ensure validating z/OS work with HFS * Change inecesary changes and fragments q * Return all test cases to normal * Return all test cases to normal * Create the local test case * Add local test case and change test case to be acurate * Get better cleanup of test-case * Update test_zos_data_set_func.py Equalize test mount func * Update ac to support a single test (#793) * Update ac to support a single test Signed-off-by: ddimatos <[email protected]> * Changelog fragment Signed-off-by: ddimatos <[email protected]> * Update test description Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * Return the dynamically created destination attributes (#773) * First iteration to get dynamic values * Spaces and lines rectified * Add validation and extra variable to ensure consistency * Whitespaces * Change imports in test_zos_mount_func * Update test_zos_fetch_func imports * Update all imports for pipelines runs * Revert "Update all imports for pipelines runs" This reverts commit 1b370a2ba3c0001c316e0121ddab82ae7cc6d75d. Return one commit * Update data_set.py imports * Revert "Update data_set.py imports" This reverts commit 37561b0a12e04faaee8307a5541b71469dbe721d. * Update data_set imports * Update data_set imports * Update data_set imports * Restore import * Restore the imports * Add fragment * Solve a ty…

* Staging v1.12.0 beta.1 (#1771) * Fix fetch * Fix find and continue with fetch * Catalog a vsam * Catalog a vsam * Catalog a vsam * Add name to vsam * Add name to vsam * Add name to vsam * Add name to vsam * Delete and add names to pds with member * Remove other modules dependencies * Remove hardcoded content * Modified variable definitions * removed variable assignments * Changed IMSTESTL name * Add fragment * [Bugfix][v1.9.0]short job name sends back a value error with a full stack trace as the msg (#1078) * Add types to better_args_parser * Remove unused re import * Manage spaces * Manage documentation * Manage documentation * Modify regex * Modify regex * Add fragment * Test cases * Change bool to str * Solve documentation * Remove runtime error * Remove re * Test case for owner and job id and add to changelog * Cover all cases * [Enabler][zos_copy]Refactor calls to use new alias and execute options (#1163) * Refactor zos copy and test case fixed * Update ZOAU list to include v1.3.0 (#1166) * [v1.10.0][zos_lineinfile] Removed zos_copy dependency from test cases (#1152) * Changed zos_copy to echo * Modified test case * Added changelog * [v1.10.0][zos_fetch] Remove zos_copy dependency from test cases (#1165) * Removed zos_copy from zos_fetch test cases * Added trailing char * Initial commit * Updated changelog * removed old fragment * Update 1165-remove-zos-copy-dep-from-zos-fetch.yml * [v1.10.0][zos_encode] Remove zos_copy dependency from test cases (#1157) * Removed zos_copy dependency * Added changelog * [v1.10.0][zos_archive] Remove zos_copy depedency from test cases (#1156) * removed zos_copy from zos_archive tests * Added changelog * [v1.10.0][zos_blockinfile] Remove zos_copy from test cases (#1167) * Removed zos_copy from test cases * Added changelog * Added file creation * [v1.10.0][zos_lineinfile] Remove zos encode from zos lineinfile (#1179) * Started removing encoding from tests * WIP * WIP * Added conversion * Removed zos_encode * Added changelog * Removed unused code * [v1.10.0] [zos_copy] Enhance zos_copy performance when copying multiple PDS members (#1183) * [v1.9.0] [zos_copy] Enhancement/764/copy members (#1176) * Changed member copy into a bulk call * Modified copy to members * Cleaned code * Removed hardcoded content from zos_copy tests * Added fix for uss files * Added distinction between uss and mvs * Added alias fix * Moved the copy section to below * Modified for seq test * Added fix for copy dest lock * Added msgs for debugging * Added final changes to member copy * Added copy for when seq to pdse * Add changelog * Added a line into docs * Modified doc * Modified doc * Update changelog * Created a new changelog * Corrected typo * zos_operator - ZOAU 1.3.0 migration (#1181) * adjust value of timeout param which the module measures in seconds to centiseconds for zoau v1.3.x+ migration Signed-off-by: Ketan Kelkar <[email protected]> * rename timeout param in helper functions to distinguish unit of measurement - timeout_s and timeout_c Signed-off-by: Ketan Kelkar <[email protected]> * add changelog Signed-off-by: Ketan Kelkar <[email protected]> * update copyright year Signed-off-by: Ketan Kelkar <[email protected]> --------- Signed-off-by: Ketan Kelkar <[email protected]> Co-authored-by: Fernando Flores <[email protected]> * [v1.10.0] [Enabler] [job] ZOAU v1.3.0 migration for job.py (#1169) * Update calls to jobs * Update copyright years * Add changelog fragment * Rename changelog fragment * Fix references to None types * Update 1169-util-job-zoau-migration.yml --------- Co-authored-by: Fernando Flores <[email protected]> * [v1.10.0] [module_utils/copy.py] Implement ZOAU 1.3 migration changes into module_utils/copy.py (#1187) * Replaced zoau datasets import * Updated changelog * Updated changelog * Modified copyright year * Update 1187-migrate-module-utils-copy.yml * [v1.10.0] [module_utils/dd_statement.py] Implement ZOAU 1.3 migration changes into module_utils/dd_statement.py (#1190) * Migrated module_utils/dd_statement * Added changelog * Update 1190-migrate-module_utils-dd_statement.yml * [v1.10.0] [module_utils/backup.py] Implement ZOAU 1.3 migration changes into module_utils/backup.py (#1188) * Changed datasets call to zoau 1.3 * Updated changelog * Corrected changelog location and tag * Corrected copyright dates * Removed wrong exception raise * Removed unused var * [v1.10.0][module_utils/data_set.py] Implement ZOAU 1.3 migration changes into module_utils/data_set.py (#1182) * Made changes to module utils * Added traceback import * Updated changelog * Changed year * Updated zoau import * Update 1182-migrate-module-utils-data-set.yml * Changed build zoau args to dataset type * [Enabler] [zos_copy] Remove zos_fetch call in loadlib test (#1184) * Remove zos_fetch call in loadlib test * Add changelog fragment * Change use of cp to dcp * Add delay to last zos_copy call * Change dcp call * Disable cleanup temporarily * Change tmp dir used * Change scp for sftp * Turn cleanup on once again * Removed print statement --------- Co-authored-by: Fernando Flores <[email protected]> * [v1.10.0] [module_utils/encode.py] Implement ZOAU 1.3 migration changes into module_utils/encode.py (#1189) * Updated module_utils encode * Updated changelog * Update 1189-migrate-module_utils-encode.yml * Modified datasets.create call * Changed datasets.create call * [v1.10.0] [zos_gather_facts] ZOAU 1.3 migration - zos_gather_facts (#1196) * update module to leverage zoau python api for zinfo Signed-off-by: Ketan Kelkar <[email protected]> * add changelog fragment Signed-off-by: Ketan Kelkar <[email protected]> * address pep8 issues Signed-off-by: Ketan Kelkar <[email protected]> * update catch-all error message Signed-off-by: Ketan Kelkar <[email protected]> --------- Signed-off-by: Ketan Kelkar <[email protected]> * [v1.10.0] [zos_backup_restore]Added choices for space type (#1200) * Added choices for space type * Added changelog * Cherry picked removed hard coded content from staging-v1.9.0-beta.1 (#1194) * Cherry picked removed hard coded content from staging-v1.9.0-beta.1 Added preferred volumes changes [v1.10.0] [zos_copy] Enhance zos_copy performance when copying multiple PDS members (#1183) * [v1.9.0] [zos_copy] Enhancement/764/copy members (#1176) * Changed member copy into a bulk call * Modified copy to members * Cleaned code * Removed hardcoded content from zos_copy tests * Added fix for uss files * Added distinction between uss and mvs * Added alias fix * Moved the copy section to below * Modified for seq test * Added fix for copy dest lock * Added msgs for debugging * Added final changes to member copy * Added copy for when seq to pdse * Add changelog * Added a line into docs * Modified doc * Modified doc * Update changelog * Created a new changelog * Corrected typo Fix for empty volumes on test_config Added comment to remind uncomment test case in the future Add more validation Add more validation Add more validation Add to config volumes and remove upper case variable name * Added keyword into tests --------- Co-authored-by: André Marcel Gutiérrez Benítez <[email protected]> * Cherry picked 1.9.0 beta.1 into dev (#1207) * Merge Staging release v1.9.0 beta.1 into main (#1205) * Add max_rc support for module zos_tso_command (#666) * rebuilding 565 * fixing pep8 issue * corrected not in code, added functional test to use maxrc * changing maxrc return codes as indicated * updated copy_rexx to incorporate max_rc * pep8 issue on an if statement * changed test to dump intermediate values temporarily * added max_rc to arg params to get it to pass through * removed extra output on test * Added changelog fragment. * Update 565-zos_tsocommand_maxrc.yml * PARTIAL correction based on reviewer's feedback. Will complete later today. * Partial push: change origrc to orig_rc and added documentation. Added experimental loop for multiline results. Changed error case to continue through the commands even after a failure (?!) * Changes based on review feedback: - rc is actual returned value - origrc/orig_rc removed - in a list of commands, first error (considering max_rc) stops the chain - while processing commands, a list of success/failures are kept for error state info - changed listds to a longer, more complete string in example * updated test case for max_rc to use longer, more complete listds command * Minor pep8 and yamllint changes * Updated string builder to use append and join, for efficiency. * Update changelog fragment to correspond to pull request number Signed-off-by: ddimatos <[email protected]> * removed old fragment Signed-off-by: ddimatos <[email protected]> * Changed output of command-by-command to use max_rc instead of Max RC, for consistency. * clarifying failure message when user hasn't set a max_rc. * corrected date on copyright notice to include current year. * corrected copyright date on test case --------- Signed-off-by: ddimatos <[email protected]> Co-authored-by: Demetri <[email protected]> * added changelog fragment Signed-off-by: ddimatos <[email protected]> * zos_copy forward port a test case for symbols on a volume #739 (#740) * added test case for symbols on a volume Signed-off-by: ddimatos <[email protected]> * Changelog fragment added Signed-off-by: ddimatos <[email protected]> * Update test case with added comments Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * Volume Initialization Module (#654) * Adding ZOS_INIT plugins The module and action for ZOS_Init command, under zos_ickdsf_command. Designed for version 1.3.1, and example given references removed zos_ssh.py. * Create zos_ickdsf_command.rst Tentative documentation. Does not quite list every return, and program may change to work with overall zos core collection. * Update zos_ickdsf_command.py fixed to pass pep8 sanity test. * Update zos_ickdsf_command.py Edited zos_ickdsf_command.py in action folder to pass pep8 style check. * bugfix - undo hard-coded storagegroup param from command passed to mvs_raw Signed-off-by: Ketan Kelkar <[email protected]> * update encoding and licensing info Signed-off-by: Ketan Kelkar <[email protected]> * edit descriptions, leaving in old to verify messaging with dfsms team Signed-off-by: Ketan Kelkar <[email protected]> * remove references to buildix Signed-off-by: Ketan Kelkar <[email protected]> * cleanup examples docstring Signed-off-by: Ketan Kelkar <[email protected]> * add return docstring Signed-off-by: Ketan Kelkar <[email protected]> * add some unit tests Signed-off-by: Ketan Kelkar <[email protected]> * update dict names, some clean up Signed-off-by: Ketan Kelkar <[email protected]> * update interface and docs with cleaner descriptions and define default values and required true/false where applicable Signed-off-by: Ketan Kelkar <[email protected]> * remove init param and bring out sub-options one level Signed-off-by: Ketan Kelkar <[email protected]> * rename module from zos_ickdsf_command to zos_ickdsf_init Signed-off-by: Ketan Kelkar <[email protected]> * remove files referring to zos_ickdsf_command; i forgot to untrack these in the previous commit Signed-off-by: Ketan Kelkar <[email protected]> * remove params from intitial definition of results dict which are not always present, remove unused return params, rename message to msg to match ibm_zos_core and ansible style Signed-off-by: Ketan Kelkar <[email protected]> * add ignore missing gplv3 license warning from sanity testings to existing ignore files Signed-off-by: Ketan Kelkar <[email protected]> * style edits to pass sanity tests Signed-off-by: Ketan Kelkar <[email protected]> * add in-depth task name to first example docstring Signed-off-by: Ketan Kelkar <[email protected]> * add minimal params functional test Signed-off-by: Ketan Kelkar <[email protected]> * convert action plugin to module_util, remove IckdsfCommand and CommandInit class definitions and custom error classes, move convert method to module_util Signed-off-by: Ketan Kelkar <[email protected]> * rename rc param, update func test Signed-off-by: Ketan Kelkar <[email protected]> * add note about disabled verify_offline check Signed-off-by: Ketan Kelkar <[email protected]> * removed volume_address checks which can be handled by ansiblemodule parsing validation or ickdsf itself; changed function signature of convert method to include results dicts so it can pass it to fail_json method in the case of module failure Signed-off-by: Ketan Kelkar <[email protected]> * add invalid volume_address func tests Signed-off-by: Ketan Kelkar <[email protected]> * change param names, organize mvscmd return output Signed-off-by: Ketan Kelkar <[email protected]> * consolidate negative func tests, add negative tests for vtoc_tracks param, start list for postive tests to implement Signed-off-by: Ketan Kelkar <[email protected]> * add func tests for "verify_existing_volid" and "verify_no_data_sets_exist" Signed-off-by: Ketan Kelkar <[email protected]> * add volid positive and negative func tests Signed-off-by: Ketan Kelkar <[email protected]> * add mutual exclusion to no index/sms_managedw with func test, minor edits to comments * add func tests for index param Signed-off-by: Ketan Kelkar <[email protected]> * add func test for vtoc_tracks param Signed-off-by: Ketan Kelkar <[email protected]> * remove 'addr_range', 'volid_prefix' and 'output_html' params; add example with ansible loop to init multiple serial volumes Signed-off-by: Ketan Kelkar <[email protected]> * convert 'content' return param to list for prettier playbook output Signed-off-by: Ketan Kelkar <[email protected]> * add specific examples to docstring Signed-off-by: Ketan Kelkar <[email protected]> * add guard rail test with volser check set to ensure target volume is as expected Signed-off-by: Ketan Kelkar <[email protected]> * switch target test vol to user02, remove existing data sets in initial test Signed-off-by: Ketan Kelkar <[email protected]> * start adding author names to docstring, edits of yaml for sanity test Signed-off-by: Ketan Kelkar <[email protected]> * rename module to zos_volume_init Signed-off-by: Ketan Kelkar <[email protected]> * remove unit test suite which was not kept up to date with code restructure Signed-off-by: Ketan Kelkar <[email protected]> * remove old/outdated .rst file Signed-off-by: Ketan Kelkar <[email protected]> * bring up to speed with v1.5.0-beta.1 which is currently more recent than dev Signed-off-by: Ketan Kelkar <[email protected]> * add sanity test 2.15 file Signed-off-by: Ketan Kelkar <[email protected]> * clean up trailing empty lines/space chars Signed-off-by: Ketan Kelkar <[email protected]> * more pep8 style Signed-off-by: Ketan Kelkar <[email protected]> * pull in more changes from latest dev branch Signed-off-by: Ketan Kelkar <[email protected]> * tweak tests/sanity/ignore-2.10.txt file Signed-off-by: Ketan Kelkar <[email protected]> * rename volume_address to address, rename verify_no_data_sets_exist to verify_volume_empty, rename verify_existing_volid to verify_volid, rename vtoc_tracks to vtoc_size, rename return param command to cmd, make suggested doc changes, switch off check_mode Signed-off-by: Ketan Kelkar <[email protected]> * resolve pep8 line too long issue Signed-off-by: Ketan Kelkar <[email protected]> * add year to copyright, add gh user name to author, restyle true/false with code rather than italics, remove backslashes in docstring Signed-off-by: Ketan Kelkar <[email protected]> * add changelog fragment Signed-off-by: Ketan Kelkar <[email protected]> * update zos_fetch test case to create data set instead of using one that gets wiped away by zos_volume_init test cases Signed-off-by: Ketan Kelkar <[email protected]> * address PR comments including pep8 styling, docstring changes including add seealso section, add details around authorized usage of ickdsf, some light wordsmithing, and remove cmd from return structure Signed-off-by: Ketan Kelkar <[email protected]> * add backticks to other special chars in docs for consistency Signed-off-by: Ketan Kelkar <[email protected]> * on more formatting tweak to national chars in docstring Signed-off-by: Ketan Kelkar <[email protected]> * add new param to support tmp_hlq Signed-off-by: Ketan Kelkar <[email protected]> * extend tmphlq binding to sysprint(*), disable verbose mode for mvscmd call Signed-off-by: Ketan Kelkar <[email protected]> * remove references to betterargparser - it cannot be used in its current state as it is too restrictive on volume serial and qualifier args Signed-off-by: Ketan Kelkar <[email protected]> * remove soft language ie beware, please; reduce line lengths, fix a spelling error Signed-off-by: Ketan Kelkar <[email protected]> * reorganize test case code for more logical grouping and un-nesting from a for loop, also update copyright year that was missed Signed-off-by: Ketan Kelkar <[email protected]> * update display command check to only check particular lines instead of entire output in test_volid_address_assigned_correctly which would always be positive when tested against the entire output Signed-off-by: Ketan Kelkar <[email protected]> --------- Signed-off-by: Ketan Kelkar <[email protected]> Co-authored-by: trevor-glassey <[email protected]> * Ported bugfixes for #664 and #678 from 1.5.0 (#743) * Ported bugfixes for #664 and #678 * Updated file normalization for sequential datasets * Fixed encoding when a remote source is used * Added encoding normalization for record length (#664) This is a port and tweak from the normalization found in the L2 support branch. Now the normalization applies for both local and remote source files. There is still work left to validate how this behaves when copying to partitioned datasets, and see if the normalization needs to handle directories as well. * Refactored normalization for USS files * Updated line endings normalization in PDSEs * Updated create_temp_with_lf_endings * Added tests for line endings normalization * Added changelog fragment * Updated changelog fragment * Updated copyright information * Added comments to record length tests * Added more context to the record length normalization * Add force (disp=shr) option to zos_lineinfile and update zos_blockinfile with the same locking test case. (#731) * Add DISP=SHR by function force to the user * Add helper function for force cases only for EOF inserts * Test cases added * Just to check in the change case * All test cases for force in zos_lineinfile working properly * Test cases for force blockinfile * Fixes for style of code * One identation error * One identation error * One identation error * Documentation error * All test cases for line infile and block infile * Comments * Change the stdout to assert with expected of ds * Error of test case * Fragment added * Solve typo errors * Update to remove uncessary comment Signed-off-by: ddimatos <[email protected]> * Update changelog fragment Signed-off-by: ddimatos <[email protected]> * Update module with force comments Signed-off-by: ddimatos <[email protected]> * Solve some test problems * Copyright year * Copyright year * Add cases for other ecodes * Add test for all encodings * Cover all encodes test cases with force * Blockinfile force added for other encodes and DS types --------- Signed-off-by: ddimatos <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> Co-authored-by: ddimatos <[email protected]> * remove duplicate function (#753) * Update branch production branch Main with release v1.5.0 content (#756) (#758) * Bug fix to correct job log returining and other edge cases (#688) * Update zos_job_submit to handle some edge cases and return the job log nearly always * Linting correction * Add changelog fragement for pr 683 * Clean up comments in code * Update restructured text for modules and changelog fragment * Add support to check for security exception to job submit module * Add additonal logic for jobs that use typerun=scan * Update chnagelog fragment * Correct run on sentence --------- * Added additional `D SYMBOLS` example to zos_operator documentation (#729) * Update zos_operator with an additional example * Added change fragment --------- * Ported bugfixes for #664 and #678 * Updated file normalization for sequential datasets * Fixed encoding when a remote source is used * Added encoding normalization for record length (#664) This is a port and tweak from the normalization found in the L2 support branch. Now the normalization applies for both local and remote source files. There is still work left to validate how this behaves when copying to partitioned datasets, and see if the normalization needs to handle directories as well. * Refactored normalization for USS files * Updated line endings normalization in PDSEs * Updated create_temp_with_lf_endings * Added tests for line endings normalization * Added changelog fragment * Add copy lib member test case * Corrected changelog fragment * Add conflict resolution * Update 641-copy-loadlib-member.yml * zos_copy forward port a test case for symbols on a volume (#739) * Add a test case for symbols using an existing volume on our test system * Add changelog fragment * Update 739-zos_copy-volume-symbol-test.yml Update description to use symbols overs special chars. * Update test case with added comments --------- * bring in updates to zos_gather_facts RETURN docstring (#744) * Solve problem 619 about set mode on dest file (#746) * Solve problem 619 about set mode on dest file * Add fragment of 746 PR --------- * Merge release tasks for v1.5.0 into release branch (#752) * Updated metadata * Updated copyright information * Updated copyright in README * Generated changelog * Added previous versions to changelog * Changed a minor_change fragment to bugfix * Updated release notes * Update dependency finder to allow for all tests minus skip tests * Update release notes and changelog with full date formats --------- * remove changelog fragments no longer needed (#754) --------- Signed-off-by: ddimatos <[email protected]> Signed-off-by: Ketan Kelkar <[email protected]> Co-authored-by: Ivan Moreno <[email protected]> Co-authored-by: Fernando Flores <[email protected]> Co-authored-by: Rich Parker <[email protected]> Co-authored-by: ketankelkar <[email protected]> Co-authored-by: André Marcel Gutiérrez Benítez <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> * Merge master to dev for 1.6.0 beta.1 (#763) * Update branch production branch Main with release v1.5.0 content (#756) * Bug fix to correct job log returining and other edge cases (#688) * Update zos_job_submit to handle some edge cases and return the job log nearly always Signed-off-by: ddimatos <[email protected]> * Linting correction Signed-off-by: ddimatos <[email protected]> * Add changelog fragement for pr 683 Signed-off-by: ddimatos <[email protected]> * Clean up comments in code Signed-off-by: ddimatos <[email protected]> * Update restructured text for modules and changelog fragment Signed-off-by: ddimatos <[email protected]> * Add support to check for security exception to job submit module Signed-off-by: ddimatos <[email protected]> * Add additonal logic for jobs that use typerun=scan Signed-off-by: ddimatos <[email protected]> * Update chnagelog fragment Signed-off-by: ddimatos <[email protected]> * Correct run on sentence Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * Added additional `D SYMBOLS` example to zos_operator documentation (#729) * Update zos_operator with an additional example Signed-off-by: ddimatos <[email protected]> * Added change fragment Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * Ported bugfixes for #664 and #678 * Updated file normalization for sequential datasets * Fixed encoding when a remote source is used * Added encoding normalization for record length (#664) This is a port and tweak from the normalization found in the L2 support branch. Now the normalization applies for both local and remote source files. There is still work left to validate how this behaves when copying to partitioned datasets, and see if the normalization needs to handle directories as well. * Refactored normalization for USS files * Updated line endings normalization in PDSEs * Updated create_temp_with_lf_endings * Added tests for line endings normalization * Added changelog fragment * Add copy lib member test case * Corrected changelog fragment * Add conflict resolution * Update 641-copy-loadlib-member.yml * zos_copy forward port a test case for symbols on a volume (#739) * Add a test case for symbols using an existing volume on our test system Signed-off-by: ddimatos <[email protected]> * Add changelog fragment Signed-off-by: ddimatos <[email protected]> * Update 739-zos_copy-volume-symbol-test.yml Update description to use symbols overs special chars. * Update test case with added comments Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * bring in updates to zos_gather_facts RETURN docstring (#744) Signed-off-by: Ketan Kelkar <[email protected]> * Solve problem 619 about set mode on dest file (#746) * Solve problem 619 about set mode on dest file * Add fragment of 746 PR --------- Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> * Merge release tasks for v1.5.0 into release branch (#752) * Updated metadata * Updated copyright information * Updated copyright in README * Generated changelog * Added previous versions to changelog * Changed a minor_change fragment to bugfix * Updated release notes * Update dependency finder to allow for all tests minus skip tests Signed-off-by: ddimatos <[email protected]> * Update release notes and changelog with full date formats Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> Co-authored-by: ddimatos <[email protected]> * remove changelog fragments no longer needed (#754) Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> Signed-off-by: Ketan Kelkar <[email protected]> Co-authored-by: Ivan Moreno <[email protected]> Co-authored-by: Fernando Flores <[email protected]> Co-authored-by: Rich Parker <[email protected]> Co-authored-by: ketankelkar <[email protected]> Co-authored-by: André Marcel Gutiérrez Benítez <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> * v1.6.0-beta.1 release (#759) * Added tagging of converted files * Updated tests for zos_encode * Added restoration of PDS/PDSE members when module fails zos_copy can now track which members got overwritten or newly added to a partitioned data set, and restore them accordingly. This commit includes a refactorization of the copy_to_pdse method to simplify the restoration work. * Fixed cleanup of dest when module fails * Removed exception used for debugging * Added pytest markers * solved pep8 issue * Added more information to error when restoration fails * Update make file with new features to manage the nodes (#563) * Update make file with new features to manage the nodes Signed-off-by: ddimatos <[email protected]> * Correct typo Signed-off-by: ddimatos <[email protected]> * updated makefile to allow for no password in the clear and added a new host Signed-off-by: ddimatos <[email protected]> Signed-off-by: ddimatos <[email protected]> * Fix a bug that failed to copy the cert to the managed node (#577) Signed-off-by: ddimatos <[email protected]> Signed-off-by: ddimatos <[email protected]> * Added apropiate error message in zos_lineinfile when src is not found * Better error message * Added fragment for changelog * Update git issue slection field (#593) * Update git issue slection field * Added some additional future versions * Added rule to ignore python 2.7 compile not supporting f strings * Corrected rule in ignore file * Update 584-zos_lineinfile-error-message.yml * Added missing fragments for issues 309 and 408 * update make file and related artifacts with recent zVM changes (#598) Signed-off-by: ddimatos <[email protected]> Signed-off-by: ddimatos <[email protected]> * Expand what is ingored for venv to all venv's (#613) Signed-off-by: ddimatos <[email protected]> Signed-off-by: ddimatos <[email protected]> * Ansible-core versions with updated ignore file pass (#615) * Validated that ansible-core versions with updated ignore file pass locally Signed-off-by: ddimatos <[email protected]> * remove redundant entry on last line Signed-off-by: ddimatos <[email protected]> * remove redundant entry on last line Signed-off-by: ddimatos <[email protected]> Signed-off-by: ddimatos <[email protected]> * Update make file to read exported var VENV else default to 'venv' (#614) * Update make file to read exported var VENV else default to 'venv' Signed-off-by: ddimatos <[email protected]> * Correct the default from defaultValue to 'venv' Signed-off-by: ddimatos <[email protected]> * Bugfix/558/zos copy backup dev (#609) * Create emergency backup only if force is set to False and dest exists * Added Changelog fragment * Updated imports ansible.module_utils._text to ansible.module_utils.common.text.converters (#602) * Updated import in zos_fetch * Updated import in zos_job_submit * Updated import in module_utils/data_set * Updated import in module_utils/System * Updated import in zos_copy * Updated import in zos_fetch * Added changelog fragment * Update enhancement-518-text-converter-import.yml * Updates the makefile and related scripts for the latest mounts (#628) * Update makefile coments and use --ignore for pytest Signed-off-by: ddimatos <[email protected]> * lexicographical order targets Signed-off-by: ddimatos <[email protected]> * Update makefile and artifacts to support new mounts Signed-off-by: ddimatos <[email protected]> * Removing encrypted versions of the scripts, no longer senstive content Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * update profile created for mount points Signed-off-by: ddimatos <[email protected]> * Correct f-string usage to remain 2.7 compatible (#659) * Correct f-string usage to remain 2.7 compatible Signed-off-by: ddimatos <[email protected]> * Update changelog fragments Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * Updated shell scripts for development tooling Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Add issue template updates Signed-off-by: ddimatos <[email protected]> * Update collab template Signed-off-by: ddimatos <[email protected]> * Update collab template Signed-off-by: ddimatos <[email protected]> * Update collab template Signed-off-by: ddimatos <[email protected]> * Template updates Signed-off-by: ddimatos <[email protected]> * Template updates Signed-off-by: ddimatos <[email protected]> * add udpated checkbox to collab template Signed-off-by: ddimatos <[email protected]> * add udpated checkbox to collab template Signed-off-by: ddimatos <[email protected]> * add udpated checkbox to collab template Signed-off-by: ddimatos <[email protected]> * add udpated checkbox to collab template Signed-off-by: ddimatos <[email protected]> * add udpated checkbox to collab template Signed-off-by: ddimatos <[email protected]> * add udpated checkbox to collab template Signed-off-by: ddimatos <[email protected]> * changed zos_job_query to allow multi/embedded wildcard job_values. job.py/_get_job_status now uses fnmatch to test for wildcarded job_names. added test looking for a wildcard job name. added basic changelog text as 'enhancement'. * expanded wildcard support to job_id as well as job_name corrected error-handling issue in query routine playbook tests complete * cleaned up pep8 issues * Bug fix to correct job log returining and other edge cases (#683) * Update zos_job_submit to handle some edge cases and return the job log nearly always Signed-off-by: ddimatos <[email protected]> * Linting correction Signed-off-by: ddimatos <[email protected]> * Add changelog fragement for pr 683 Signed-off-by: ddimatos <[email protected]> * Clean up comments in code Signed-off-by: ddimatos <[email protected]> * Update restructured text for modules and changelog fragment Signed-off-by: ddimatos <[email protected]> * Add support to check for security exception to job submit module Signed-off-by: ddimatos <[email protected]> * Add additonal logic for jobs that use typerun=scan Signed-off-by: ddimatos <[email protected]> * Update chnagelog fragment Signed-off-by: ddimatos <[email protected]> * Update zos_job_submit.py Grammar change and correction. --------- Signed-off-by: ddimatos <[email protected]> * Added uss_tag_encoding function * Fixing linter issues * removed extraneous comment on query, eliminated unused variable * responding to reviewer comments * Expanded query tests to run a hello jcl file to make sure we are searching for a job id that exists. * Expanded documentation in code to highlight asterisk availability. Added examples showing multi-asterisk search. * Corrected 2 documentation errors * Change to documentation text (indent on multi line string?) * Still trying to get documentation to pass * Looks like '---' was killing documentation block. * Update zos_blockinfile with complex examples (#727) * Update zos_blockinfile with complex examples Signed-off-by: ddimatos <[email protected]> * Add changelog fragement Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * Added additional D SYMBOLS example to zos_operator documentation (#730) * Update zos_operator with an additional example Signed-off-by: ddimatos <[email protected]> * Added changelog fragment Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * zos_gather_facts - add sample output to RETURN docstring (#722) * zos_gather_facts - add sample output to RETURN docstring Signed-off-by: Ketan Kelkar <[email protected]> * add changelog fragment Signed-off-by: Ketan Kelkar <[email protected]> * zos_gather_facts RETURN docstring - add sample sysplex_name and lpar_name values Signed-off-by: Ketan Kelkar <[email protected]> * Update generated module doc Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: Ketan Kelkar <[email protected]> Signed-off-by: ddimatos <[email protected]> Co-authored-by: ddimatos <[email protected]> * 574find (#668) * change to allow find loop to continue when one particular data set element is not found This has been validated with a zos-check-find.yaml playbook * added functional test that includes non-existant pds entry, which should be skipped over * added changelog fragment. * zos_blockinfile , can quotes in content can be supported (#680) * Verify coomand of ZOAU support the doble quotes and get better output of message * Verify coomand of ZOAU support the doble quotes and get better output of message * Restore to the one tyme function solving TypeError * Test about cases with quotes supported * Solve comments * Comments in the changelog * Adjust test for working accord the text * A needed space * All in structured * Comments solved * Better order --------- Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> Co-authored-by: Demetri <[email protected]> * zos_copy mode is applied to the destination directory, a deviation from the communtiy module behavior. (#723) * Verify coomand of ZOAU support the doble quotes and get better output of message * Verify coomand of ZOAU support the doble quotes and get better output of message * Restore to the one tyme function solving TypeError * Test about cases with quotes supported * Solve comments * Comments in the changelog * Adjust test for working accord the text * Solve the dest functional mode set for the applied to destination directory * Identation and spaces * To work well * To work well * To work well * To work well * Changelogs added * Solved the fragment test and separte the cases --------- Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> * corrected job test case that wanted to extract job id. * changed call to zos_job_query in the functional test. * zos_data_set - add force parameter to enable member delete via disp shr (#718) * add force parameter to enable member delete via disp shr Signed-off-by: Ketan Kelkar <[email protected]> * update link to PR instead of issue Signed-off-by: Ketan Kelkar <[email protected]> * fix minor mistake in func test Signed-off-by: Ketan Kelkar <[email protected]> * update DOCstring for missed items highlighted in PR review Signed-off-by: Ketan Kelkar <[email protected]> * update copyright years in data set module util Signed-off-by: Ketan Kelkar <[email protected]> --------- Signed-off-by: Ketan Kelkar <[email protected]> * Update changelog fragment Signed-off-by: ddimatos <[email protected]> * Update to doc and examples Signed-off-by: ddimatos <[email protected]> * Update to doc and examples Signed-off-by: ddimatos <[email protected]> * Update to doc and examples Signed-off-by: ddimatos <[email protected]> * update doc, rst Signed-off-by: ddimatos <[email protected]> * Update doc and examples Signed-off-by: ddimatos <[email protected]> * Added handler for job not found edge cases (None not iterable errors) * corrected pep8 issue (bad indent) * removed tracking text from error/not found messages. * Update zos_job_query.py * Add and automate a load lib test case for module zos_copy (#640) * Modified if statement * Added changelog fragment * Corrected statements Corrected PR in changelog fix lint issue * Adding test case on the work * Added assertion to loadlib test Changed cobol src Added newlines * Correcting cobol src * Removed unnecessary comments * Removed deprint statements for debug * Update 601-copy-loadlib-member.yml * Reduce space primary * Make sure cobol is executable * corrected name * Corrected names * Adding debug statements * modified name in link step * Changing copy name * Removed print statements for debug * Removed previous changelog * Removed unused fragment * Removed test case * Add max_rc support for module zos_tso_command (#666) * rebuilding 565 * fixing pep8 issue * corrected not in code, added functional test to use maxrc * changing maxrc return codes as indicated * updated copy_rexx to incorporate max_rc * pep8 issue on an if statement * changed test to dump intermediate values temporarily * added max_rc to arg params to get it to pass through * removed extra output on test * Added changelog fragment. * Update 565-zos_tsocommand_maxrc.yml * PARTIAL correction based on reviewer's feedback. Will complete later today. * Partial push: change origrc to orig_rc and added documentation. Added experimental loop for multiline results. Changed error case to continue through the commands even after a failure (?!) * Changes based on review feedback: - rc is actual returned value - origrc/orig_rc removed - in a list of commands, first error (considering max_rc) stops the chain - while processing commands, a list of success/failures are kept for error state info - changed listds to a longer, more complete string in example * updated test case for max_rc to use longer, more complete listds command * Minor pep8 and yamllint changes * Updated string builder to use append and join, for efficiency. * Update changelog fragment to correspond to pull request number Signed-off-by: ddimatos <[email protected]> * removed old fragment Signed-off-by: ddimatos <[email protected]> * Changed output of command-by-command to use max_rc instead of Max RC, for consistency. * clarifying failure message when user hasn't set a max_rc. * corrected date on copyright notice to include current year. * corrected copyright date on test case --------- Signed-off-by: ddimatos <[email protected]> Co-authored-by: Demetri <[email protected]> * added changelog fragment Signed-off-by: ddimatos <[email protected]> * zos_copy forward port a test case for symbols on a volume #739 (#740) * added test case for symbols on a volume Signed-off-by: ddimatos <[email protected]> * Changelog fragment added Signed-off-by: ddimatos <[email protected]> * Update test case with added comments Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * Volume Initialization Module (#654) * Adding ZOS_INIT plugins The module and action for ZOS_Init command, under zos_ickdsf_command. Designed for version 1.3.1, and example given references removed zos_ssh.py. * Create zos_ickdsf_command.rst Tentative documentation. Does not quite list every return, and program may change to work with overall zos core collection. * Update zos_ickdsf_command.py fixed to pass pep8 sanity test. * Update zos_ickdsf_command.py Edited zos_ickdsf_command.py in action folder to pass pep8 style check. * bugfix - undo hard-coded storagegroup param from command passed to mvs_raw Signed-off-by: Ketan Kelkar <[email protected]> * update encoding and licensing info Signed-off-by: Ketan Kelkar <[email protected]> * edit descriptions, leaving in old to verify messaging with dfsms team Signed-off-by: Ketan Kelkar <[email protected]> * remove references to buildix Signed-off-by: Ketan Kelkar <[email protected]> * cleanup examples docstring Signed-off-by: Ketan Kelkar <[email protected]> * add return docstring Signed-off-by: Ketan Kelkar <[email protected]> * add some unit tests Signed-off-by: Ketan Kelkar <[email protected]> * update dict names, some clean up Signed-off-by: Ketan Kelkar <[email protected]> * update interface and docs with cleaner descriptions and define default values and required true/false where applicable Signed-off-by: Ketan Kelkar <[email protected]> * remove init param and bring out sub-options one level Signed-off-by: Ketan Kelkar <[email protected]> * rename module from zos_ickdsf_command to zos_ickdsf_init Signed-off-by: Ketan Kelkar <[email protected]> * remove files referring to zos_ickdsf_command; i forgot to untrack these in the previous commit Signed-off-by: Ketan Kelkar <[email protected]> * remove params from intitial definition of results dict which are not always present, remove unused return params, rename message to msg to match ibm_zos_core and ansible style Signed-off-by: Ketan Kelkar <[email protected]> * add ignore missing gplv3 license warning from sanity testings to existing ignore files Signed-off-by: Ketan Kelkar <[email protected]> * style edits to pass sanity tests Signed-off-by: Ketan Kelkar <[email protected]> * add in-depth task name to first example docstring Signed-off-by: Ketan Kelkar <[email protected]> * add minimal params functional test Signed-off-by: Ketan Kelkar <[email protected]> * convert action plugin to module_util, remove IckdsfCommand and CommandInit class definitions and custom error classes, move convert method to module_util Signed-off-by: Ketan Kelkar <[email protected]> * rename rc param, update func test Signed-off-by: Ketan Kelkar <[email protected]> * add note about disabled verify_offline check Signed-off-by: Ketan Kelkar <[email protected]> * removed volume_address checks which can be handled by ansiblemodule parsing validation or ickdsf itself; changed function signature of convert method to include results dicts so it can pass it to fail_json method in the case of module failure Signed-off-by: Ketan Kelkar <[email protected]> * add invalid volume_address func tests Signed-off-by: Ketan Kelkar <[email protected]> * change param names, organize mvscmd return output Signed-off-by: Ketan Kelkar <[email protected]> * consolidate negative func tests, add negative tests for vtoc_tracks param, start list for postive tests to implement Signed-off-by: Ketan Kelkar <[email protected]> * add func tests for "verify_existing_volid" and "verify_no_data_sets_exist" Signed-off-by: Ketan Kelkar <[email protected]> * add volid positive and negative func tests Signed-off-by: Ketan Kelkar <[email protected]> * add mutual exclusion to no index/sms_managedw with func test, minor edits to comments * add func tests for index param Signed-off-by: Ketan Kelkar <[email protected]> * add func test for vtoc_tracks param Signed-off-by: Ketan Kelkar <[email protected]> * remove 'addr_range', 'volid_prefix' and 'output_html' params; add example with ansible loop to init multiple serial volumes Signed-off-by: Ketan Kelkar <[email protected]> * convert 'content' return param to list for prettier playbook output Signed-off-by: Ketan Kelkar <[email protected]> * add specific examples to docstring Signed-off-by: Ketan Kelkar <[email protected]> * add guard rail test with volser check set to ensure target volume is as expected Signed-off-by: Ketan Kelkar <[email protected]> * switch target test vol to user02, remove existing data sets in initial test Signed-off-by: Ketan Kelkar <[email protected]> * start adding author names to docstring, edits of yaml for sanity test Signed-off-by: Ketan Kelkar <[email protected]> * rename module to zos_volume_init Signed-off-by: Ketan Kelkar <[email protected]> * remove unit test suite which was not kept up to date with code restructure Signed-off-by: Ketan Kelkar <[email protected]> * remove old/outdated .rst file Signed-off-by: Ketan Kelkar <[email protected]> * bring up to speed with v1.5.0-beta.1 which is currently more recent than dev Signed-off-by: Ketan Kelkar <[email protected]> * add sanity test 2.15 file Signed-off-by: Ketan Kelkar <[email protected]> * clean up trailing empty lines/space chars Signed-off-by: Ketan Kelkar <[email protected]> * more pep8 style Signed-off-by: Ketan Kelkar <[email protected]> * pull in more changes from latest dev branch Signed-off-by: Ketan Kelkar <[email protected]> * tweak tests/sanity/ignore-2.10.txt file Signed-off-by: Ketan Kelkar <[email protected]> * rename volume_address to address, rename verify_no_data_sets_exist to verify_volume_empty, rename verify_existing_volid to verify_volid, rename vtoc_tracks to vtoc_size, rename return param command to cmd, make suggested doc changes, switch off check_mode Signed-off-by: Ketan Kelkar <[email protected]> * resolve pep8 line too long issue Signed-off-by: Ketan Kelkar <[email protected]> * add year to copyright, add gh user name to author, restyle true/false with code rather than italics, remove backslashes in docstring Signed-off-by: Ketan Kelkar <[email protected]> * add changelog fragment Signed-off-by: Ketan Kelkar <[email protected]> * update zos_fetch test case to create data set instead of using one that gets wiped away by zos_volume_init test cases Signed-off-by: Ketan Kelkar <[email protected]> * address PR comments including pep8 styling, docstring changes including add seealso section, add details around authorized usage of ickdsf, some light wordsmithing, and remove cmd from return structure Signed-off-by: Ketan Kelkar <[email protected]> * add backticks to other special chars in docs for consistency Signed-off-by: Ketan Kelkar <[email protected]> * on more formatting tweak to national chars in docstring Signed-off-by: Ketan Kelkar <[email protected]> * add new param to support tmp_hlq Signed-off-by: Ketan Kelkar <[email protected]> * extend tmphlq binding to sysprint(*), disable verbose mode for mvscmd call Signed-off-by: Ketan Kelkar <[email protected]> * remove references to betterargparser - it cannot be used in its current state as it is too restrictive on volume serial and qualifier args Signed-off-by: Ketan Kelkar <[email protected]> * remove soft language ie beware, please; reduce line lengths, fix a spelling error Signed-off-by: Ketan Kelkar <[email protected]> * reorganize test case code for more logical grouping and un-nesting from a for loop, also update copyright year that was missed Signed-off-by: Ketan Kelkar <[email protected]> * update display command check to only check particular lines instead of entire output in test_volid_address_assigned_correctly which would always be positive when tested against the entire output Signed-off-by: Ketan Kelkar <[email protected]> --------- Signed-off-by: Ketan Kelkar <[email protected]> Co-authored-by: trevor-glassey <[email protected]> * Ported bugfixes for #664 and #678 from 1.5.0 (#743) * Ported bugfixes for #664 and #678 * Updated file normalization for sequential datasets * Fixed encoding when a remote source is used * Added encoding normalization for record length (#664) This is a port and tweak from the normalization found in the L2 support branch. Now the normalization applies for both local and remote source files. There is still work left to validate how this behaves when copying to partitioned datasets, and see if the normalization needs to handle directories as well. * Refactored normalization for USS files * Updated line endings normalization in PDSEs * Updated create_temp_with_lf_endings * Added tests for line endings normalization * Added changelog fragment * Updated changelog fragment * Updated copyright information * Added comments to record length tests * Added more context to the record length normalization * Add force (disp=shr) option to zos_lineinfile and update zos_blockinfile with the same locking test case. (#731) * Add DISP=SHR by function force to the user * Add helper function for force cases only for EOF inserts * Test cases added * Just to check in the change case * All test cases for force in zos_lineinfile working properly * Test cases for force blockinfile * Fixes for style of code * One identation error * One identation error * One identation error * Documentation error * All test cases for line infile and block infile * Comments * Change the stdout to assert with expected of ds * Error of test case * Fragment added * Solve typo errors * Update to remove uncessary comment Signed-off-by: ddimatos <[email protected]> * Update changelog fragment Signed-off-by: ddimatos <[email protected]> * Update module with force comments Signed-off-by: ddimatos <[email protected]> * Solve some test problems * Copyright year * Copyright year * Add cases for other ecodes * Add test for all encodings * Cover all encodes test cases with force * Blockinfile force added for other encodes and DS types --------- Signed-off-by: ddimatos <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> Co-authored-by: ddimatos <[email protected]> * remove duplicate function (#753) * Update branch production branch Main with release v1.5.0 content (#756) (#758) * Bug fix to correct job log returining and other edge cases (#688) * Update zos_job_submit to handle some edge cases and return the job log nearly always * Linting correction * Add changelog fragement for pr 683 * Clean up comments in code * Update restructured text for modules and changelog fragment * Add support to check for security exception to job submit module * Add additonal logic for jobs that use typerun=scan * Update chnagelog fragment * Correct run on sentence --------- * Added additional `D SYMBOLS` example to zos_operator documentation (#729) * Update zos_operator with an additional example * Added change fragment --------- * Ported bugfixes for #664 and #678 * Updated file normalization for sequential datasets * Fixed encoding when a remote source is used * Added encoding normalization for record length (#664) This is a port and tweak from the normalization found in the L2 support branch. Now the normalization applies for both local and remote source files. There is still work left to validate how this behaves when copying to partitioned datasets, and see if the normalization needs to handle directories as well. * Refactored normalization for USS files * Updated line endings normalization in PDSEs * Updated create_temp_with_lf_endings * Added tests for line endings normalization * Added changelog fragment * Add copy lib member test case * Corrected changelog fragment * Add conflict resolution * Update 641-copy-loadlib-member.yml * zos_copy forward port a test case for symbols on a volume (#739) * Add a test case for symbols using an existing volume on our test system * Add changelog fragment * Update 739-zos_copy-volume-symbol-test.yml Update description to use symbols overs special chars. * Update test case with added comments --------- * bring in updates to zos_gather_facts RETURN docstring (#744) * Solve problem 619 about set mode on dest file (#746) * Solve problem 619 about set mode on dest file * Add fragment of 746 PR --------- * Merge release tasks for v1.5.0 into release branch (#752) * Updated metadata * Updated copyright information * Updated copyright in README * Generated changelog * Added previous versions to changelog * Changed a minor_change fragment to bugfix * Updated release notes * Update dependency finder to allow for all tests minus skip tests * Update release notes and changelog with full date formats --------- * remove changelog fragments no longer needed (#754) --------- Signed-off-by: ddimatos <[email protected]> Signed-off-by: Ketan Kelkar <[email protected]> Co-authored-by: Ivan Moreno <[email protected]> Co-authored-by: Fernando Flores <[email protected]> Co-authored-by: Rich Parker <[email protected]> Co-authored-by: ketankelkar <[email protected]> Co-authored-by: André Marcel Gutiérrez Benítez <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> * update galaxy and meta/ files Signed-off-by: Ketan Kelkar <[email protected]> * update copyright years Signed-off-by: Ketan Kelkar <[email protected]> * update rst doc files Signed-off-by: Ketan Kelkar <[email protected]> * add 1.6.0-beta.1 release summary fragment Signed-off-by: Ketan Kelkar <[email protected]> * generate changelog Signed-off-by: Ketan Kelkar <[email protected]> * add release notes Signed-off-by: Ketan Kelkar <[email protected]> * add additional stylizing Signed-off-by: Ketan Kelkar <[email protected]> * Delete fragements once changelog is generated Signed-off-by: ddimatos <[email protected]> * update stylizing around *none* in zos_volume_init docs Signed-off-by: Ketan Kelkar <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> Signed-off-by: Ketan Kelkar <[email protected]> Co-authored-by: Ivan Moreno <[email protected]> Co-authored-by: Oscar Fernando Flores Garcia <[email protected]> Co-authored-by: Demetri <[email protected]> Co-authored-by: Rich Parker <[email protected]> Co-authored-by: André Marcel Gutiérrez Benítez <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> Co-authored-by: trevor-glassey <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> * Update ibm_zos_core_meta.yml --------- Signed-off-by: ddimatos <[email protected]> Signed-off-by: Ketan Kelkar <[email protected]> Co-authored-by: Ivan Moreno <[email protected]> Co-authored-by: Fernando Flores <[email protected]> Co-authored-by: Rich Parker <[email protected]> Co-authored-by: ketankelkar <[email protected]> Co-authored-by: André Marcel Gutiérrez Benítez <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> Co-authored-by: trevor-glassey <[email protected]> Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> * Bugfix/619/mode set for files applied test case (#757) * Add test case for copy dest file * Add comments * Add test for folders * Adjust spaces * Changes for ensure consistency for all tests * Changes of name and clean creations --------- Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> * Bugfix/381/failed when the job name was null or not found (#747) * Add the verbose for failed when job name was null or not found * Adjust message for what we can get * Whitespaces move * Add code from dev * Ecode utility as is in dev * Year for copyright * Case for having both the jod_id and job_name * Ecode utils functions not in my branch * Add final line ecode * Add fragment * Delete encode function two times, adjust job message and change the fragment * Change variable name for one more descriptive * Restore encode and change one word * Encode * bugfixes * Set up as dev * Better fragment --------- Co-authored-by: Andre Marcel Gutierrez Benitez <[email protected]> Co-authored-by: Fernando Flores <[email protected]> * Bugfix/660/zos operator reported failure caused by unrelated error response messages (#762) * Add options * Add transparency on the response and test cases * Solve spaces * Add validation to append * Fragment Added * Adjust fail_json on non_zero response * Identation mistakes solved * Solve last idenation problem * Replace prior tooling (makefile) that aidded the development workflow with a new 'ac' command. (#766) * Make file mount script helper Signed-off-by: ddimatos <[email protected]> * Comments to mount script Signed-off-by: ddimatos <[email protected]> * Staged updated scripts for makefile usage Signed-off-by: ddimatos <[email protected]> * Update mount scripts for use with makefile Signed-off-by: ddimatos <[email protected]> * updates to correct mounts and add function to mounts-datasets Signed-off-by: ddimatos <[email protected]> * adding completed new ac command files for development Signed-off-by: ddimatos <[email protected]> * update ignore to more specific with venv Signed-off-by: ddimatos <[email protected]> * Correcting ignore to allow for venv.sh Signed-off-by: ddimatos <[email protected]> * moved logic that checks for info.env to venv.sh Signed-off-by: ddimatos <[email protected]> * Adding changelog fragment Signed-off-by: ddimatos <[email protected]> * Fix a path issue when calling venv.sh Signed-off-by: ddimatos <[email protected]> * Fixes issue not being able to run all tests, fixes issue with content being written to collections folder Signed-off-by: ddimatos <[email protected]> * Support zSH and update scp to fall back to legacy scp protocal Signed-off-by: ddimatos <[email protected]> * Update ac with password usage Signed-off-by: ddimatos <[email protected]> * Update ac with password usage Signed-off-by: ddimatos <[email protected]> * Fix incorrect message and remove the cd's before and after ac-test Signed-off-by: ddimatos <[email protected]> --------- Signed-off-by: ddimatos <[email protected]> * 347 new query fields (#778) * changing job.py to return 7 more fields, and for zos_job_query to pass them through * corrected testing to pull all new values through this assumes zoau 1.2.3 and z/OS at least 2.4 need to test older zoau to make sure this will still work * Added zoau version testing import to job.py so it won't reach for non-existent members. * pep8 and lint required changes * changed test to see if it will pass unit testing * Modified test_zos_data_set_func to skip HFS test if zOS > 02.04 * changed OS test for hfs usage * corrected usage of 'hosts'... removed the definition in prior edit. * changing OS version checker * corrected string extraction for OS version checker * added delete shell to 196/197 (finally of cat/uncat test) removed success message from 830 (version test logic) * removed the mvscmdauth call, as it coincides with some new test failures. * added changed=false back into testing of job_query * correction of zos->zoau name in comments. * Missing fragment in PR 778 New query fields (#780) * added fragment for pr 778 * Added changelog fragment query new fields Added changelog fragment query new fields * Update 778-query-new-fields.yml * Update docs with ansible/ansible-core version, AAP and fix the dated git issue templates (#771) * Doc vesion updates Signed-off-by: ddimatos <[email protected]> * Repository template updates and future proofing Signed-off-by: ddimatos <dimatos…

fernandofloresg and others added 30 commits December 18, 2023 11:16

fix undefined variable

00561fb

Add changelog

f501463

Modified changelog

f84389f

Merge pull request #1101 from ansible-collections/bugfix/undefined-va…

06a4aec

…r-job-submit [zos_job_submit] Fix undefined variable

Merge branch 'dev' into enable/997-999/update-sanity-test-ignore-9-11

141edfc

Merge pull request #1091 from ansible-collections/enable/997-999/upda…

b4e4139

…te-sanity-test-ignore-9-11 Update zos job submit undocumented argument and import exception

Change in fetch

753e107

Modify fetch

da5b8c7

Fix fetch

9c7344f

Fix find and continue with fetch

d608196

Catalog a vsam

f470f2f

Catalog a vsam

c736986

Catalog a vsam

dff9a22

Add name to vsam

2b6fd8a

Add name to vsam

e8db735

Add name to vsam

c6c8459

Add name to vsam

75a1e34

Delete and add names to pds with member

65c48c0

Merge branch 'dev' into enabler/Test_zos_fetch_find_remove_hardcoded_…

9be8624

…datasets

Remove other modules dependencies

5d495d0

Merge branch 'enabler/Test_zos_fetch_find_remove_hardcoded_datasets' of

49f5e2a

https://github.com/ansible-collections/ibm_zos_core into enabler/Test_zos_fetch_find_remove_hardcoded_datasets

Remove hardcoded content

4dbe17d

Modified variable definitions

8a0cf6c

removed variable assignments

f91978b

Changed IMSTESTL name

6fb2d46

Add fragment

9f3d982

Merge pull request #1158 from ansible-collections/enabler/Test_zos_fe…

a0a85fe

…tch_find_remove_hardcoded_datasets Test zos fetch find remove hardcoded datasets

[Enabler][zos_copy]Refactor calls to use new alias and execute options (

dd8db39

#1163) * Refactor zos copy and test case fixed

Update ZOAU list to include v1.3.0 (#1166)

df4189b

ddimatos added 9 commits October 24, 2024 22:33

Update release notes

f1482d3

Signed-off-by: ddimatos <[email protected]>

update release notes formatting

5792d5c

Signed-off-by: ddimatos <[email protected]>

Update modules content_type to share address space types

e15832d

Signed-off-by: ddimatos <[email protected]>

Update and escape the content_type

341cc74

Signed-off-by: ddimatos <[email protected]>

udpate RST based on module doc changes

bd857e1

Signed-off-by: ddimatos <[email protected]>

Remove fragments before releasing

be08989

Signed-off-by: ddimatos <[email protected]>

Add timeouts to job submits

0906176

Signed-off-by: ddimatos <[email protected]>

Add IDs to test so pytest can collect it without escaping special chars

fbd8f44

Signed-off-by: ddimatos <[email protected]>

ddimatos marked this pull request as ready for review October 28, 2024 05:35

ddimatos requested review from ketankelkar, fernandofloresg, richp405, AndreMarcel99 and rexemin and removed request for ketankelkar and fernandofloresg October 28, 2024 05:35

ddimatos added 2 commits October 27, 2024 23:16

Merged two lines in notes

6ca1be9

Signed-off-by: ddimatos <[email protected]>

Fixed missing space

0a394cd

Signed-off-by: ddimatos <[email protected]>

richp405 reviewed Oct 28, 2024

View reviewed changes

docs/source/modules/zos_fetch.rst Outdated Show resolved Hide resolved

richp405 approved these changes Oct 28, 2024

View reviewed changes

ddimatos added 2 commits October 28, 2024 13:29

Update the modules tmp_hlq description

d25c7e3

Signed-off-by: ddimatos <[email protected]>

Update module doc to better explain the sftp error option

0ae284e

Signed-off-by: ddimatos <[email protected]>

fernandofloresg approved these changes Oct 29, 2024

View reviewed changes

plugins/modules/zos_blockinfile.py Outdated Show resolved Hide resolved

doc updates that came from the PR

b9adb75

Signed-off-by: ddimatos <[email protected]>

ddimatos merged commit 2b87759 into main Oct 29, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Staging v1.12.0 beta.1 #1771

Staging v1.12.0 beta.1 #1771

ddimatos commented Oct 27, 2024

richp405 left a comment

fernandofloresg left a comment

Staging v1.12.0 beta.1 #1771

Staging v1.12.0 beta.1 #1771

Conversation

ddimatos commented Oct 27, 2024

SUMMARY

richp405 left a comment

Choose a reason for hiding this comment

fernandofloresg left a comment

Choose a reason for hiding this comment