Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ERROR AsWriterTask Aerospike Write Error: -7 #54

Open
azamshaikh-ai opened this issue Oct 25, 2024 · 4 comments
Open

ERROR AsWriterTask Aerospike Write Error: -7 #54

azamshaikh-ai opened this issue Oct 25, 2024 · 4 comments
Assignees

Comments

@azamshaikh-ai
Copy link

I have been getting
ERROR AsWriterTask :158 - File: file.csv Line: 8Aerospike Write Error: -7
ERROR AsWriterTask :158 - File: file.csv Line: 11Aerospike Write Error: -7
ERROR AsWriterTask :158 - File: file.csv Line: 13Aerospike Write Error: -7
above error multiple times while loading data in AS set, resulting in those data missing from the table after the loader has finished.

Command I am running to load data
./run_loader -h host-p port-e 2700 -n mynamespace -c config.json file.csv

However there is no issue on lines mentioned, and those error are random with loader running multiple times, sometime its work and other time it gives similar error on different or same lines.

ASLoader I have is built via git repo as available on help/documentation page.

Is there anyway to address the above issue to make sure all data are inserted properly. Or any other way to insert data to Aerospike from CSV.

@dwelch-spike
Copy link
Contributor

Hello, -7 is the Java client error for max connection exceeded. So asloader must be hitting its connection limit. https://javadoc.io/doc/com.aerospike/aerospike-client-jdk8/latest/com/aerospike/client/ResultCode.html#NO_MORE_CONNECTIONS

The max connections logic recently changed so there may be an issue there.
a83aef3

We will look into it.

In the mean time, could you post the output of a run using the --verbose flag, Specifically there should be a line that says Max connections per node that I'd like to see. Also, how many nodes are in your Aerospike cluster?

@azamshaikh-ai
Copy link
Author

Thanks for your response. As I mentioned the error occurs randomly sometimes it keep coming, I will add the flag and repost the messages here.
I use community edition of aerospike, has only single node and 2 namespaces. less than 20 sets altogether.
Is there any other of loading data to aerospike from csv using bash script?

@dwelch-spike
Copy link
Contributor

@azamshaikh-ai You could use a script with one of our client SDKs, for example the Python client, something like https://stackoverflow.com/questions/36378076/how-to-import-csv-file-data-in-aerospike-without-using-aerospike-loaderis-there .

We are looking into this issue.

@dwelch-spike
Copy link
Contributor

@azamshaikh-ai There should also be verbose output about "Using writer Threads:" and "Using reader Threads:". Please post those lines when you have verbose output. Thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants