"KeyError: 'role_" - Error while running orders: botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://sts.US.amazonaws.com/"

[GlowSharpie]

I've double, triple, and quadruple checked ALL of my credentials and I have followed each step in amazon's documentation at https://developer-docs.amazon.com/sp-api/docs/creating-and-configuring-iam-policies-and-entities however every time I run my code I receive the following error:

Traceback (most recent call last):
File "F:\Python\lib\site-packages\cachetools_init_.py", line 68, in getitem
return self.__data[key]
KeyError: 'role_74fc5af19254feae9a64bd3255ef2ac6'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "F:\Python\lib\site-packages\sp_api\base\client.py", line 112, in role
role = role_cache[cache_key]
File "F:\Python\lib\site-packages\cachetools_init_.py", line 418, in getitem
return cache_getitem(self, key)
File "F:\Python\lib\site-packages\cachetools_init_.py", line 70, in getitem
return self.missing(key)
File "F:\Python\lib\site-packages\cachetools_init_.py", line 97, in missing
raise KeyError(key)
KeyError: 'role_74fc5af19254feae9a64bd3255ef2ac6'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "c:\Users\GlowSharpie\Desktop\Python Scripts\Barcode Creation\FBA\SP API\SP_API_Test3.py", line 16, in
order = order_client.get_order('113-2528766-2545802')
File "F:\Python\lib\site-packages\sp_api\base\helpers.py", line 20, in wrapper
return function(*args, **kwargs)
File "F:\Python\lib\site-packages\sp_api\api\orders\orders.py", line 95, in get_order
return self._request(fill_query_params(kwargs.pop('path'), order_id), params={**kwargs}, add_marketplace=False)
File "F:\Python\lib\site-packages\sp_api\base\client.py", line 153, in _request
auth=self._sign_request(),
File "F:\Python\lib\site-packages\sp_api\base\client.py", line 122, in _sign_request
role = self.role
File "F:\Python\lib\site-packages\sp_api\base\client.py", line 114, in role
role = self.set_role(cache_key)
File "F:\Python\lib\site-packages\sp_api\base\client.py", line 81, in set_role
role = self.boto3_client.assume_role(
File "F:\Python\lib\site-packages\botocore\client.py", line 530, in _api_call
return self._make_api_call(operation_name, kwargs)
File "F:\Python\lib\site-packages\botocore\client.py", line 943, in _make_api_call
http, parsed_response = self._make_request(
File "F:\Python\lib\site-packages\botocore\client.py", line 966, in _make_request
return self._endpoint.make_request(operation_model, request_dict)
File "F:\Python\lib\site-packages\botocore\endpoint.py", line 119, in make_request
return self._send_request(request_dict, operation_model)
File "F:\Python\lib\site-packages\botocore\endpoint.py", line 202, in _send_request
while self._needs_retry(
File "F:\Python\lib\site-packages\botocore\endpoint.py", line 354, in _needs_retry
responses = self._event_emitter.emit(
File "F:\Python\lib\site-packages\botocore\hooks.py", line 412, in emit
return self._emitter.emit(aliased_event_name, **kwargs)
File "F:\Python\lib\site-packages\botocore\hooks.py", line 256, in emit
return self._emit(event_name, kwargs)
File "F:\Python\lib\site-packages\botocore\hooks.py", line 239, in _emit
response = handler(**kwargs)
File "F:\Python\lib\site-packages\botocore\retryhandler.py", line 207, in call
if self._checker(**checker_kwargs):
File "F:\Python\lib\site-packages\botocore\retryhandler.py", line 284, in call
should_retry = self._should_retry(
File "F:\Python\lib\site-packages\botocore\retryhandler.py", line 320, in _should_retry
return self._checker(attempt_number, response, caught_exception)
File "F:\Python\lib\site-packages\botocore\retryhandler.py", line 363, in call
checker_response = checker(
File "F:\Python\lib\site-packages\botocore\retryhandler.py", line 247, in call
return self._check_caught_exception(
File "F:\Python\lib\site-packages\botocore\retryhandler.py", line 416, in _check_caught_exception
raise caught_exception
File "F:\Python\lib\site-packages\botocore\endpoint.py", line 281, in _do_get_response
http_response = self._send(request)
File "F:\Python\lib\site-packages\botocore\endpoint.py", line 377, in _send
return self.http_session.send(request)
File "F:\Python\lib\site-packages\botocore\httpsession.py", line 484, in send
raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://sts.US.amazonaws.com/"
PS C:\Users\GlowSharpie\Desktop\Python Scripts\Barcode Creation\FBA\SP API>

I have attempted to uninstall all of the site packages thinking that maybe it was a bug of some kind. However this still doesn't fix my issue either. I'm really lost and could use some guidance....

Here is my code putting in "*********" to protect the credentials:

from sp_api.base import Marketplaces
from sp_api.api import Orders
from datetime import datetime, timedelta, date

credentials = dict(
    refresh_token='Atzr|********************************************UXryc',  # From Seller central under Authorise -> Refresh Token
    lwa_app_id='amzn1.application-oa2-**************************83f',  # From Seller Central, named CLIENT IDENTIFIER on website.
    lwa_client_secret='26c*********************756e',  # From Seller Central, named CLIENT SECRET on website.
    aws_access_key='AK***********UX',  # From AWS IAM Setup
    aws_secret_key='S5***************MhF',  # From AWS IAM Setup
    `role_arn='arn:aws:iam::************:role/SellingPartnerAPI_Role'`  #arn:aws:iam::1234567890:role/SellingPartnerAPIRole
)


order_client = Orders(credentials=credentials, marketplace=Marketplaces.US)
order = order_client.get_order('113-2528766-2545802')
print(order) # `order` is an `ApiResponse`
print(order.payload) # `payload` contains the original response

Under the user "SP_API_User" I have the following inline policy for my IAM user:

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Sid": "VisualEditor0",
            "Effect": "Allow",
            "Action": "sts:AssumeRole",
            "Resource": "arn:aws:iam::************:role/SellingPartnerAPI_Role"
        }
    ]
}

And under my role "SellingPartnerAPI_Role" is where I Invoke the access with this following Customer managed policy:

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Effect": "Allow",
            "Action": "execute-api:Invoke",
            "Resource": "arn:aws:execute-api:*:*:*"
        }
    ]
}

I also submitted the application for the refresh token, LWA client ID, and LWA Secret ID on https://sellercentral.amazon.com/sellingpartner/developerconsole/ref=xx_DevCon_dnav_xx where I have the IAM ARN setup for arn:aws:iam::************:role/SellingPartnerAPI_Role
Any help would be appreciated!

[GRBurst]

This is hard to debug without full knowledge of the infrastructure. Did you try to run it with only the aws cli and / or api tools like postman? This would help you identify if this is a problem with the infra or this library

[GlowSharpie]

So, I was able to test in postman just now and was able to retrieve the order information I was looking for. That confirms the credentials are valid and use STS correctly. There has to be some issue with the library and maybe where it is caching the data and retrieving it. However, I do not know where it is storing this data at.

My theory is that it is trying to obtain the key from somewhere using cachetools but is unable to for some reason. I've uninstalled all of those python libraries and still having this issue. So I'm not sure what to do next...

[GlowSharpie]

I have now also confirmed that this is working just fine on my other PC. So there has to be something about my current PC that is causing the issue. I still think I may just need to clear a cache of some kind but I have not been able to find it. Here is what I have attempted to clear/reinstall:

Python 3.9.7 uninstalled and reinstalled
python-amazon-sp-api(with all required site packages ie cachetools) uninstalled and reinstalled
C Drive temp files cleared

Not sure where else to check or what else I could try and clear. Any ideas of where this information is cached at would be extremely helpful!

[GRBurst]

From the error logs and paths I assume you are using a Windows pc?
Some things that you might want to check:

• are you using aws-vault with some old sessions?
• did you double check your environment variables for AWS?
• is your other pc running in the same network and do you use the same account / profile + credentials?
• did you compare your aws configuration files on both PCs?

[GlowSharpie]

Correct, I am using a Windows 10 PC. Here are some of the answers/questions I have regarding your questions:

1. I don't believe so? I don't think I am using aws-vault. But how can I check to confirm this?
2. Yes, I checked my PC's environment variables for AWS and everything seems to be in order and matching my other PC
3. Correct, the PC was running the same profile + credentials on the same network
4. Yes, the credentials are the same on both PC's. I am not currently using a configuration file. I am using the credentials straight from the code temporarily for ease of use currently. I do plan to move this to a .env file after I figure out what the issue is though.

One side note I'd like to make is my C drive is currently running low on space. Not sure if this would have anything to do with it as I have cleared it up before running this. But I did notice that it was running really low to the point where I received the notification from windows right after attempting to run the script one time. So, this may or may not be relevant.