-
Notifications
You must be signed in to change notification settings - Fork 3.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
EC2 Inventory Errors, but no error shown #13357
Comments
Logs from task pod 2022-12-20 22:23:27,932 INFO [7d97167f01bb47108a3895fb0fee2c91] awx.analytics.job_lifecycle inventoryupdate-5 acknowledged |
I did a find on the EE and the task pod for the plugin and cant find it.
Are the plugins not installed be default? |
Present in 21.10.2 as well. |
result_traceback from
|
@filipprosovsky "return binascii.a2b_base64(s)\nbinascii.Error: Incorrect padding\n",```" are you seeing that message regularly? which k8s version are you on? |
@washburnjoe does |
This will be possibly related to #11338 receptor issue, which is fixed in ansible/receptor#683 in K8S version 1.24.8 |
@fosterseth Unsure, I uninstalled last night and put in 21.9.0 because I thought the issue might have been part of #13313 I still had the problem with 21.9.0 And now I just uninstalled 21.9.0 to try another older version. I will report back ASAP |
We are using awx-operator, and there is a problem with the charts as older are not available. But I downloaded previously working release 1.0.0 and uploaded it to our ArgoCD and deployed older AWX 21.9.0 version. Same thing happening. The thing is everything was working, but before upgrade to 1.24, so I assume this will be most likely related to cases I mentioned above. At least in our case. |
I rolled back to operator 0.30.0 and AWX 21.7.0. So I am in agreement it seems to be related more to Kubernetes. Because the same problem exists. We are using Kube 1.24
|
@fosterseth increasing the container max log size did not help. Still getting the same. I set RECEPTOR_RELEASE_WORK to false and when I check logs of automation pod, I do see some base64-like long string in there:
|
@fosterseth 1.24 and yea, we cannot sync the dynamic inventory in aws using aws_ec2 plugin, as we get this error everytime we run the sync. So it is not working at all for us. |
Maybe related to ansible/ansible-runner#998 |
ansible/receptor#683 This works. Can be closed |
Thanks for letting us know @filipprosovsky . |
Please confirm the following
Bug Summary
Out of the box AWX install on Kubernetes. I created a credential for AWS with an Access Key and permissions to Read EC2. I created an inventory with source of Amazon EC2 and set the AWS credential. I have tried both warning, info and debug for the log type.
The job comes back with an error, but nothing of note in the logs and no hosts show up in inventory. Maybe I am not understanding how inventory works. As I understand it, I should get back every EC2 instance using the default settings.
AWX version
21.10.0
Select the relevant components
Installation method
kubernetes
Modifications
no
Ansible version
No response
Operating system
No response
Web browser
No response
Steps to reproduce
Create an IAM user with the built in EC2ReadOnly policy.
Create an IAM access key
Create a credential using that KEY and Secret
Make an Inventory and add a source of Amazon EC2 and set the credential you just made
sync
Expected results
I expect that I would get every EC2 instance loaded into inventory
Actual results
No inventory and the sync job has Error as the status
Log file
config file = None configured module search path = ['/home/runner/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules'] ansible python module location = /usr/local/lib/python3.8/site-packages/ansible ansible collection location = /home/runner/.ansible/collections:/usr/share/ansible/collections:/usr/share/automation-controller/collections executable location = /usr/local/bin/ansible-inventory python version = 3.8.13 (default, Jun 24 2022, 15:27:57) [GCC 8.5.0 20210514 (Red Hat 8.5.0-13)] jinja version = 2.11.3 libyaml = True No config file found; using defaults redirecting (type: inventory) ansible.builtin.aws_ec2 to amazon.aws.aws_ec2 Parsed /runner/inventory/aws_ec2.yml inventory source with auto plugin
Additional information
No response
The text was updated successfully, but these errors were encountered: