Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

not able to export when data is more than 1000 rows #52

Open
jeevitesh opened this issue Aug 26, 2014 · 6 comments
Open

not able to export when data is more than 1000 rows #52

jeevitesh opened this issue Aug 26, 2014 · 6 comments

Comments

@jeevitesh
Copy link

Hi,
I'm using hrider 1.0.82 connected to hbase. I have rows numbering 1064, if i try to export it is exporting only 64 rows. I have checked the config(global properties) and increased writesize but still it not able to export more than 1000 rows

@icher-g
Copy link

icher-g commented Aug 27, 2014

Hi,

I will check this later but meanwhile why do you need export? What do you try to accomplish?
You can change the rows number to more than 1064 before populating the table and click open in external editor. It will open in EXCEL by default and you will have all the rows exported in the comma delimited format I think.

@jeevitesh
Copy link
Author

thanks for the replay...
I need to export the data because I need to take backup...
Or could that be size issue normally It will be around 100mb of data for
1000rows...
so In global properties file i increased writeSize but no change in the
behaviour
And not able to understand why i need to create 1064 rows before populating
thanks a lot..

On Wed, Aug 27, 2014 at 6:16 PM, Igor Cher [email protected] wrote:

Hi,

I will check this later but meanwhile why do you need export? What do you
try to accomplish?
You can change the rows number to more than 1064 before populating the
table and click open in external editor. It will open in EXCEL by default
and you will have all the rows exported in the comma delimited format I
think.


Reply to this email directly or view it on GitHub
#52 (comment).

@icher-g
Copy link

icher-g commented Aug 28, 2014

What version of the h-rider do you use?
In the export dialog there are two options of export: as an .hfile or text delimited. The first option should work no matter how big your table. Keep in mind that to back up big table will take time because all the rows are being transferred into your local machine. You can also consider using hbase feature of backing up the tables. It is a map/reduce job that you can invoke from the command line.

@jeevitesh
Copy link
Author

hi ignor,
thanks for the replay...
I'll consider those options please correct if i'm wrong track...
I got this two set of java program to export hbase data to csv and import
data.* so is this is the best option or is there any better option.*
http://www.mccarroll.net/snippets/hbaseload/HBaseExporter.java
http://hbase.apache.org/xref/org/apache/hadoop/hbase/mapreduce/SampleUploader.html
thanks
jeevitesh

On Thu, Aug 28, 2014 at 12:51 PM, Igor Cher [email protected]
wrote:

What version of the h-rider do you use?
In the export dialog there are two options of export: as an .hfile or text
delimited. The first option should work no matter how big your table. Keep
in mind that to back up big table will take time because all the rows are
being transferred into your local machine. You can also consider using
hbase feature of backing up the tables. It is a map/reduce job that you can
invoke from the command line.


Reply to this email directly or view it on GitHub
#52 (comment).

@jeevitesh
Copy link
Author

hi,
tried both version h-rider-1.0.8.3-hbase-0.94.1
and h-rider-1.0.8.2-hbase-0.94.1 both having same issues not able to export

On Thu, Aug 28, 2014 at 1:00 PM, jeevi tesh [email protected] wrote:

hi ignor,
thanks for the replay...
I'll consider those options please correct if i'm wrong track...
I got this two set of java program to export hbase data to csv and import
data.* so is this is the best option or is there any better option.*
http://www.mccarroll.net/snippets/hbaseload/HBaseExporter.java

http://hbase.apache.org/xref/org/apache/hadoop/hbase/mapreduce/SampleUploader.html
thanks
jeevitesh

On Thu, Aug 28, 2014 at 12:51 PM, Igor Cher [email protected]
wrote:

What version of the h-rider do you use?
In the export dialog there are two options of export: as an .hfile or
text delimited. The first option should work no matter how big your table.
Keep in mind that to back up big table will take time because all the rows
are being transferred into your local machine. You can also consider using
hbase feature of backing up the tables. It is a map/reduce job that you can
invoke from the command line.


Reply to this email directly or view it on GitHub
#52 (comment).

@icher-g
Copy link

icher-g commented Aug 31, 2014

Hi,
There is a built in support for import/export tables from hbase.
You can try them: http://hbase.apache.org/book.html#export

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants