Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bulk loader does not work with --store_xids #3922

Closed
zhuyaoyhj opened this issue Sep 5, 2019 · 0 comments · Fixed by #3950
Closed

Bulk loader does not work with --store_xids #3922

zhuyaoyhj opened this issue Sep 5, 2019 · 0 comments · Fixed by #3950
Assignees
@ashish-goswami

Comments

@zhuyaoyhj
Copy link

- What version of Dgraph are you using?

Dgraph version   : v1.1.0  
Dgraph SHA-256   : 7d4294a80f74692695467e2cf17f74648c18087ed7057d798f40e1d3a31d2095
Commit SHA-1     : ef7cdb28
Commit timestamp : 2019-09-04 00:12:51 -0700
Branch           : HEAD
Go version       : go1.12.7

- Have you tried reproducing the issue with latest release?

Yes

- What is the hardware spec (RAM, OS)?

Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz ，linux， 128G

- Steps to reproduce the issue (command/config used to run Dgraph).

step

step 1:  zero command：
    dgraph zero --my=localhost:5200 -o 120 --replicas 3

step 2:  bulk command:
    dgraph bulk -f data.rdf -x --map_shards=4 -s data.schema --reduce_shards=1 --http localhost:8123 --zero=localhost:5200 --store_xids

content

data.rdf :
     <director.film> <http://www.w3.org/2000/01/rdf-schema#domain>   <director>  .
      <director.film> <http://www.w3.org/2000/01/rdf-schema#range>    <film>  .
data.schema:
     name: string @index(term) @lang .
     initial_release_date: datetime @index(year) .

- Expected behaviour and actual result.

Expected to bulk loader generated file with xid info.

However,the following error is shown:

Dgraph version   : v1.1.0
Dgraph SHA-256   : 7d4294a80f74692695467e2cf17f74648c18087ed7057d798f40e1d3a31d2095
Commit SHA-1     : ef7cdb28
Commit timestamp : 2019-09-04 00:12:51 -0700
Branch           : HEAD
Go version       : go1.12.7

For Dgraph official documentation, visit https://docs.dgraph.io.
For discussions about Dgraph     , visit https://discuss.dgraph.io.
To say hi to the community       , visit https://dgraph.slack.com.

Licensed variously under the Apache Public License 2.0 and Dgraph Community License.
Copyright 2015-2018 Dgraph Labs, Inc.


{
		"DataFiles": "data.rdf",
		"DataFormat": "",
		"SchemaFile": "data.schema",
		"OutDir": "./out",
		"ReplaceOutDir": false,
		"TmpDir": "tmp",
		"NumGoroutines": 8,
		"MapBufSize": 67108864,
		"SkipMapPhase": false,
		"CleanupTmp": true,
		"NumReducers": 1,
		"Version": false,
		"StoreXids": true,
		"ZeroAddr": "localhost:5200",
		"HttpAddr": "localhost:8123",
		"IgnoreErrors": false,
		"CustomTokenizers": "",
		"NewUids": false,
		"MapShards": 4,
		"ReduceShards": 1
}

The bulk loader needs to open many files at once. This number depends on the size of the data set loaded, the map file output size, and the level of indexing. 100,000 is adequate for most data set sizes. See `man ulimit` for details of how to change the limit.
Current max open files limit: 102400

Connecting to zero at localhost:5200
Processing file (1 out of 1): data.rdf
[16:54:53+0800] MAP 01s nquad_count:0.000 err_count:0.000 nquad_speed:0.000/sec edge_count:0.000 edge_speed:0.000/sec
[16:54:54+0800] MAP 02s nquad_count:0.000 err_count:0.000 nquad_speed:0.000/sec edge_count:0.000 edge_speed:0.000/sec
[16:54:55+0800] MAP 03s nquad_count:0.000 err_count:0.000 nquad_speed:0.000/sec edge_count:0.000 edge_speed:0.000/sec
[16:54:56+0800] MAP 04s nquad_count:0.000 err_count:0.000 nquad_speed:0.000/sec edge_count:0.000 edge_speed:0.000/sec
[16:54:57+0800] MAP 05s nquad_count:0.000 err_count:0.000 nquad_speed:0.000/sec edge_count:0.000 edge_speed:0.000/sec
[16:54:58+0800] MAP 06s nquad_count:0.000 err_count:0.000 nquad_speed:0.000/sec edge_count:0.000 edge_speed:0.000/sec
[16:54:59+0800] MAP 07s nquad_count:0.000 err_count:0.000 nquad_speed:0.000/sec edge_count:0.000 edge_speed:0.000/sec
[16:55:00+0800] MAP 08s nquad_count:0.000 err_count:0.000 nquad_speed:0.000/sec edge_count:0.000 edge_speed:0.000/sec
[16:55:01+0800] MAP 09s nquad_count:0.000 err_count:0.000 nquad_speed:0.000/sec edge_count:0.000 edge_speed:0.000/sec
GC: 10. InUse: 431 MB. Idle: 171 MB
[16:55:02+0800] MAP 10s nquad_count:0.000 err_count:0.000 nquad_speed:0.000/sec edge_count:0.000 edge_speed:0.000/sec
runtime: goroutine stack exceeds 1000000000-byte limit
fatal error: stack overflow

runtime stack:
runtime.throw(0x176768e, 0xe)
		/usr/local/go/src/runtime/panic.go:617 +0x72
runtime.newstack()
		/usr/local/go/src/runtime/stack.go:1041 +0x6f0
runtime.morestack()
		/usr/local/go/src/runtime/asm_amd64.s:429 +0x8f

goroutine 84 [running]:
runtime.heapBitsSetType(0xc01b1aa1b0, 0x30, 0x30, 0x16813c0)
		/usr/local/go/src/runtime/mbitmap.go:938 +0xa56 fp=0xc024000360 sp=0xc024000358 pc=0x9b98a6
runtime.mallocgc(0x30, 0x16813c0, 0x9ec201, 0xc024000450)
		/usr/local/go/src/runtime/malloc.go:969 +0x51c fp=0xc024000400 sp=0xc024000360 pc=0x9af44c
runtime.newobject(0x16813c0, 0x20)
		/usr/local/go/src/runtime/malloc.go:1068 +0x38 fp=0xc024000430 sp=0xc024000400 pc=0x9afaa8
strconv.syntaxError(...)
		/usr/local/go/src/strconv/atoi.go:27
strconv.ParseUint(0xc00048e0f1, 0xd, 0x0, 0x40, 0x6d6c69662e, 0x18, 0x30)
		/usr/local/go/src/strconv/atoi.go:117 +0x2ae fp=0xc024000478 sp=0xc024000430 pc=0xa2e5be
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:234 +0x8d fp=0xc0240004c8 sp=0xc024000478 pc=0x13f453d
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a9a70)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024000540 sp=0xc0240004c8 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024000588 sp=0xc024000540 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc0240005d8 sp=0xc024000588 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a99e0)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024000650 sp=0xc0240005d8 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024000698 sp=0xc024000650 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc0240006e8 sp=0xc024000698 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a9950)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024000760 sp=0xc0240006e8 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc0240007a8 sp=0xc024000760 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc0240007f8 sp=0xc0240007a8 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a98c0)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024000870 sp=0xc0240007f8 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc0240008b8 sp=0xc024000870 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024000908 sp=0xc0240008b8 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a9830)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024000980 sp=0xc024000908 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc0240009c8 sp=0xc024000980 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024000a18 sp=0xc0240009c8 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a97a0)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024000a90 sp=0xc024000a18 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024000ad8 sp=0xc024000a90 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024000b28 sp=0xc024000ad8 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a9710)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024000ba0 sp=0xc024000b28 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024000be8 sp=0xc024000ba0 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024000c38 sp=0xc024000be8 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a9680)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024000cb0 sp=0xc024000c38 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024000cf8 sp=0xc024000cb0 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024000d48 sp=0xc024000cf8 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a95f0)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024000dc0 sp=0xc024000d48 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024000e08 sp=0xc024000dc0 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024000e58 sp=0xc024000e08 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a9560)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024000ed0 sp=0xc024000e58 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024000f18 sp=0xc024000ed0 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024000f68 sp=0xc024000f18 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a94d0)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024000fe0 sp=0xc024000f68 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024001028 sp=0xc024000fe0 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024001078 sp=0xc024001028 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a9440)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc0240010f0 sp=0xc024001078 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024001138 sp=0xc0240010f0 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024001188 sp=0xc024001138 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a93b0)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024001200 sp=0xc024001188 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024001248 sp=0xc024001200 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024001298 sp=0xc024001248 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a9320)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024001310 sp=0xc024001298 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024001358 sp=0xc024001310 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc0240013a8 sp=0xc024001358 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a9290)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024001420 sp=0xc0240013a8 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024001468 sp=0xc024001420 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc0240014b8 sp=0xc024001468 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a9200)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024001530 sp=0xc0240014b8 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024001578 sp=0xc024001530 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc0240015c8 sp=0xc024001578 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a9170)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024001640 sp=0xc0240015c8 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024001688 sp=0xc024001640 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc0240016d8 sp=0xc024001688 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a90e0)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024001750 sp=0xc0240016d8 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024001798 sp=0xc024001750 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc0240017e8 sp=0xc024001798 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a9050)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024001860 sp=0xc0240017e8 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc0240018a8 sp=0xc024001860 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc0240018f8 sp=0xc0240018a8 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a8fc0)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024001970 sp=0xc0240018f8 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc0240019b8 sp=0xc024001970 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024001a08 sp=0xc0240019b8 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a8f30)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024001a80 sp=0xc024001a08 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024001ac8 sp=0xc024001a80 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024001b18 sp=0xc024001ac8 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a8ea0)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024001b90 sp=0xc024001b18 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024001bd8 sp=0xc024001b90 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024001c28 sp=0xc024001bd8 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a8e10)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024001ca0 sp=0xc024001c28 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024001ce8 sp=0xc024001ca0 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024001d38 sp=0xc024001ce8 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a8d80)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024001db0 sp=0xc024001d38 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024001df8 sp=0xc024001db0 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024001e48 sp=0xc024001df8 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a8cf0)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024001ec0 sp=0xc024001e48 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024001f08 sp=0xc024001ec0 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024001f58 sp=0xc024001f08 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a8c60)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024001fd0 sp=0xc024001f58 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024002018 sp=0xc024001fd0 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024002068 sp=0xc024002018 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a8bd0)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc0240020e0 sp=0xc024002068 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024002128 sp=0xc0240020e0 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024002178 sp=0xc024002128 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a8b40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc0240021f0 sp=0xc024002178 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024002238 sp=0xc0240021f0 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024002288 sp=0xc024002238 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a8ab0)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024002300 sp=0xc024002288 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024002348 sp=0xc024002300 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc024002398 sp=0xc024002348 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a8a20)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024002410 sp=0xc024002398 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024002458 sp=0xc024002410 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc0240024a8 sp=0xc024002458 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a8990)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024002520 sp=0xc0240024a8 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024002568 sp=0xc024002520 pc=0x13f4702
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).uid(0xc000504720, 0xc00048e0f1, 0xd, 0xc00040a978)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:240 +0x4f fp=0xc0240025b8 sp=0xc024002568 pc=0x13f44ff
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).processNQuad(0xc000504720, 0xc01b1a8900)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:208 +0x52 fp=0xc024002630 sp=0xc0240025b8 pc=0x13f4152
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*mapper).lookupUid(0xc000504720, 0xc00048e0f1, 0xd, 0x40)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/mapper.go:259 +0x162 fp=0xc024002678 sp=0xc024002630 pc=0x13f4702
created by github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*loader).mapStage
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/loader.go:174 +0x203

goroutine 1 [semacquire]:
sync.runtime_Semacquire(0xc0001084a8)
		/usr/local/go/src/runtime/sema.go:56 +0x39
sync.(*WaitGroup).Wait(0xc0001084a0)
		/usr/local/go/src/sync/waitgroup.go:130 +0x65
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*loader).mapStage(0xc0005046f0)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/loader.go:209 +0x506
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.run()
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/run.go:230 +0xcd2
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.init.0.func1(0xc000034480, 0xc0004544d0, 0x0, 0xb)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/run.go:50 +0x52
github.com/dgraph-io/dgraph/vendor/github.com/spf13/cobra.(*Command).execute(0xc000034480, 0xc00012d6b0, 0xb, 0xb, 0xc000034480, 0xc00012d6b0)
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/github.com/spf13/cobra/command.go:702 +0x289
github.com/dgraph-io/dgraph/vendor/github.com/spf13/cobra.(*Command).ExecuteC(0x22121a0, 0x0, 0x0, 0x0)
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/github.com/spf13/cobra/command.go:783 +0x2ca
github.com/dgraph-io/dgraph/vendor/github.com/spf13/cobra.(*Command).Execute(...)
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/github.com/spf13/cobra/command.go:736
github.com/dgraph-io/dgraph/dgraph/cmd.Execute()
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/root.go:68 +0x85
main.main()
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/main.go:33 +0x99

goroutine 19 [chan receive]:
github.com/dgraph-io/dgraph/vendor/github.com/golang/glog.(*loggingT).flushDaemon(0x22b9b20)
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/github.com/golang/glog/glog.go:882 +0x8b
created by github.com/dgraph-io/dgraph/vendor/github.com/golang/glog.init.0
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/github.com/golang/glog/glog.go:410 +0x272

goroutine 36 [select]:
github.com/dgraph-io/dgraph/vendor/go.opencensus.io/stats/view.(*worker).start(0xc00011e140)
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/go.opencensus.io/stats/view/worker.go:154 +0x100
created by github.com/dgraph-io/dgraph/vendor/go.opencensus.io/stats/view.init.0
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/go.opencensus.io/stats/view/worker.go:32 +0x57

goroutine 37 [syscall]:
os/signal.signal_recv(0x0)
		/usr/local/go/src/runtime/sigqueue.go:139 +0x9c
os/signal.loop()
		/usr/local/go/src/os/signal/signal_unix.go:23 +0x22
created by os/signal.init.0
		/usr/local/go/src/os/signal/signal_unix.go:29 +0x41

goroutine 38 [chan receive]:
github.com/dgraph-io/dgraph/x.init.0.func1(0x19465a0, 0xc000108010)
		/tmp/go/src/github.com/dgraph-io/dgraph/x/metrics.go:210 +0xe1
created by github.com/dgraph-io/dgraph/x.init.0
		/tmp/go/src/github.com/dgraph-io/dgraph/x/metrics.go:206 +0x93

goroutine 22 [chan receive]:
github.com/dgraph-io/dgraph/worker.(*rateLimiter).bleed(0x22d6638)
		/tmp/go/src/github.com/dgraph-io/dgraph/worker/proposal.go:67 +0xae
created by github.com/dgraph-io/dgraph/worker.init.0
		/tmp/go/src/github.com/dgraph-io/dgraph/worker/proposal.go:50 +0x41

goroutine 32 [IO wait]:
internal/poll.runtime_pollWait(0x7f1bc19d9f28, 0x72, 0xffffffffffffffff)
		/usr/local/go/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc000180418, 0x72, 0x8000, 0x8000, 0xffffffffffffffff)
		/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
		/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc000180400, 0xc000484000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
		/usr/local/go/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc000180400, 0xc000484000, 0x8000, 0x8000, 0x0, 0x800010601, 0x0)
		/usr/local/go/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc000120000, 0xc000484000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
		/usr/local/go/src/net/net.go:177 +0x69
bufio.(*Reader).Read(0xc0005b2180, 0xc000428038, 0x9, 0x9, 0xc0000c8000, 0x7f1bc6e44460, 0x0)
		/usr/local/go/src/bufio/bufio.go:223 +0x23e
io.ReadAtLeast(0x191d920, 0xc0005b2180, 0xc000428038, 0x9, 0x9, 0x9, 0xd73f55, 0xc0009b226c, 0xc0000afe38)
		/usr/local/go/src/io/io.go:310 +0x88
io.ReadFull(...)
		/usr/local/go/src/io/io.go:329
github.com/dgraph-io/dgraph/vendor/golang.org/x/net/http2.readFrameHeader(0xc000428038, 0x9, 0x9, 0x191d920, 0xc0005b2180, 0x0, 0xc000000000, 0x2bec2a2b, 0x22b9200)
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/golang.org/x/net/http2/frame.go:237 +0x88
github.com/dgraph-io/dgraph/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc000428000, 0xc0009b2260, 0xc0009b2260, 0x0, 0x0)
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/golang.org/x/net/http2/frame.go:492 +0xa1
github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000222380)
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1236 +0x168
created by github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc/internal/transport/http2_client.go:286 +0xd15

goroutine 33 [select]:
github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0000c40c0, 0x1, 0x0, 0x0, 0x0, 0x0)
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:317 +0x104
github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0005dc960, 0x0, 0x0)
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:435 +0x1b6
github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc000222380)
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc/internal/transport/http2_client.go:330 +0x7b
created by github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc/internal/transport/http2_client.go:328 +0xeb2

goroutine 59 [IO wait]:
internal/poll.runtime_pollWait(0x7f1bc19d9ff8, 0x72, 0x0)
		/usr/local/go/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc000180118, 0x72, 0x0, 0x0, 0x175f8ce)
		/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
		/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Accept(0xc000180100, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
		/usr/local/go/src/internal/poll/fd_unix.go:384 +0x1ba
net.(*netFD).accept(0xc000180100, 0x16ba600, 0x50, 0xc00046ca00)
		/usr/local/go/src/net/fd_unix.go:238 +0x42
net.(*TCPListener).accept(0xc00010a058, 0xc000580000, 0x7f1bc6e436d0, 0x0)
		/usr/local/go/src/net/tcpsock_posix.go:139 +0x32
net.(*TCPListener).AcceptTCP(0xc00010a058, 0x9afaa8, 0x30, 0x16ba600)
		/usr/local/go/src/net/tcpsock.go:247 +0x48
net/http.tcpKeepAliveListener.Accept(0xc00010a058, 0x16ba600, 0xc0005a8840, 0x15ef600, 0x21fa260)
		/usr/local/go/src/net/http/server.go:3264 +0x2f
net/http.(*Server).Serve(0xc0005ae0d0, 0x19419a0, 0xc00010a058, 0x0, 0x0)
		/usr/local/go/src/net/http/server.go:2859 +0x22d
net/http.(*Server).ListenAndServe(0xc0005ae0d0, 0xc0005ae0d0, 0x0)
		/usr/local/go/src/net/http/server.go:2797 +0xe4
net/http.ListenAndServe(...)
		/usr/local/go/src/net/http/server.go:3037
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.run.func1(0xc00059d590)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/run.go:175 +0x94
created by github.com/dgraph-io/dgraph/dgraph/cmd/bulk.run
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/run.go:174 +0x96e

goroutine 60 [chan receive]:
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.run.func2()
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/run.go:214 +0xec
created by github.com/dgraph-io/dgraph/dgraph/cmd/bulk.run
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/run.go:208 +0xbff

goroutine 61 [select]:
github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0005b4800)
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:115 +0x110
created by github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc.newCCBalancerWrapper
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:106 +0x14f

goroutine 62 [chan receive]:
github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc000136780)
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc/clientconn.go:1040 +0x5a1
created by github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc.(*addrConn).connect
		/tmp/go/src/github.com/dgraph-io/dgraph/vendor/google.golang.org/grpc/clientconn.go:700 +0xb6

goroutine 82 [select]:
github.com/dgraph-io/dgraph/dgraph/cmd/bulk.(*progress).report(0xc000204000)
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/progress.go:67 +0xc5
created by github.com/dgraph-io/dgraph/dgraph/cmd/bulk.newLoader
		/tmp/go/src/github.com/dgraph-io/dgraph/dgraph/cmd/bulk/loader.go:115 +0x680

goroutine 83 [chan send]:
github.com/dgraph-io/dgraph/xidmap.New.func2(0xc0000c4740)
		/tmp/go/src/github.com/dgraph-io/dgraph/xidmap/xidmap.go:130 +0x29f
created by github.com/dgraph-io/dgraph/xidmap.New
		/tmp/go/src/github.com/dgraph-io/dgraph/xidmap/xidmap.go:118 +0x241

I remove --store_xids

dgraph bulk -f data.rdf -x --map_shards=4 -s data.schema --reduce_shards=1 --http localhost:8123 --zero=localhost:5200

result is shown:

Dgraph version   : v1.1.0
Dgraph SHA-256   : 7d4294a80f74692695467e2cf17f74648c18087ed7057d798f40e1d3a31d2095
Commit SHA-1     : ef7cdb28
Commit timestamp : 2019-09-04 00:12:51 -0700
Branch           : HEAD
Go version       : go1.12.7

For Dgraph official documentation, visit https://docs.dgraph.io.
For discussions about Dgraph     , visit https://discuss.dgraph.io.
To say hi to the community       , visit https://dgraph.slack.com.

Licensed variously under the Apache Public License 2.0 and Dgraph Community License.
Copyright 2015-2018 Dgraph Labs, Inc.


{
		"DataFiles": "data.rdf",
		"DataFormat": "",
		"SchemaFile": "data.schema",
		"OutDir": "./out",
		"ReplaceOutDir": false,
		"TmpDir": "tmp",
		"NumGoroutines": 8,
		"MapBufSize": 67108864,
		"SkipMapPhase": false,
		"CleanupTmp": true,
		"NumReducers": 1,
		"Version": false,
		"StoreXids": false,
		"ZeroAddr": "localhost:5200",
		"HttpAddr": "localhost:8124",
		"IgnoreErrors": false,
		"CustomTokenizers": "",
		"NewUids": false,
		"MapShards": 4,
		"ReduceShards": 1
}

The bulk loader needs to open many files at once. This number depends on the size of the data set loaded, the map file output size, and the level of indexing. 100,000 is adequate for most data set sizes. See `man ulimit` for details of how to change the limit.
Current max open files limit: 102400

Connecting to zero at localhost:5200
Processing file (1 out of 1): data.rdf
Shard tmp/shards/000 -> Reduce tmp/shards/shard_0/000
Shard tmp/shards/001 -> Reduce tmp/shards/shard_0/001
[17:12:56+0800] REDUCE 00s 100.00% edge_count:2.000 edge_speed:2.000/sec plist_count:2.000 plist_speed:2.000/sec
Total: 00s

If you have a question, please ask it on https://discuss.dgraph.io
Our Docs: https://docs.dgraph.io/
Slack Channel: https://slack.dgraph.io/
@ashish-goswami ashish-goswami self-assigned this Sep 9, 2019
@ashish-goswami ashish-goswami mentioned this issue Sep 9, 2019
Merged
ashish-goswami added a commit that referenced this issue Sep 11, 2019
@ashish-goswami
Fix bug in bulk loader when store_xids is true(#3950)
097d320 
In mapper stage of bulk loader, NQuads are processed by calling processNQuad(). If store_xids is true, we create extra NQuad for xid and uid mapping and call processNQuad(). Ideally this should be done only once. But we were not tracking if we had already created NQuad or not. This was resulting in multiple recursive calls to processNQuad() and leading to overflowing of stack.
This PR fixes it by returning true/false from AssignUid() of xidmap. When it returns false, we know its an old Uid and avoid creating extra NQuad and recursive call to processNQuad(). 

Fixes: #3922
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ashish-goswami ashish-goswami

Labels
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix bulk loader store_xids issue dgraph-io/dgraph
2 participants
@ashish-goswami @zhuyaoyhj