[Flaky Test] Filebeat test_registrar.Test.test_clean_removed_with_clean_inactive #10606

ruflin · 2019-02-06T10:10:01Z

Flaky Test

Test Name: test_registrar.Test.test_clean_removed_with_clean_inactive
Branch: master
Artifact Link: https://beats-ci.elastic.co/job/elastic+beats+pull-request+multijob-linux/4809/beat=filebeat,label=ubuntu/testReport/junit/test_registrar/Test/test_clean_removed_with_clean_inactive/

Artifcats

Below is a zip file with the Artifacts from the build:

test_registrar.Test.test_clean_removed_with_clean_inactive.zip

ruflin · 2019-02-06T10:12:19Z

This seems to be similar to #9215 but now also for Linux

See elastic#10606 for more details.

See #10606 for more details.

urso · 2019-02-18T11:43:49Z

Close in #10747

kvch · 2019-03-13T10:37:29Z

The test failed again on Windows
Job: https://beats-ci.elastic.co/job/elastic+beats+pull-request+multijob-windows/5947/beat=filebeat,label=windows/

  File "c:\python27\lib\unittest\case.py", line 329, in run
    testMethod()
  File "C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\tests\system\test_registrar.py", line 905, in test_clean_removed_with_clean_inactive
    assert count == 2

-------------------- >> begin captured stdout << ---------------------
render config
registry size: 0

--------------------- >> end captured stdout << ----------------------

Logs

2019-03-13T09:50:15.292Z	INFO	instance/beat.go:567	Home path: [C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive] Config path: [C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive] Data path: [C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\data] Logs path: [C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\logs]
2019-03-13T09:50:15.294Z	DEBUG	[beat]	instance/beat.go:619	Beat metadata path: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\data\meta.json
2019-03-13T09:50:15.297Z	INFO	instance/beat.go:574	Beat ID: da642272-27a0-4d96-8974-f5238a2fe3ce
2019-03-13T09:50:15.298Z	INFO	[index-management.ilm]	ilm/ilm.go:123	Policy name: filebeat-8.0.0
2019-03-13T09:50:15.299Z	DEBUG	[seccomp]	seccomp/seccomp.go:88	Syscall filtering is only supported on Linux
2019-03-13T09:50:15.299Z	INFO	[beat]	instance/beat.go:822	Beat info	{"system_info": {"beat": {"path": {"config": "C:\\Users\\jenkins\\workspace\\elastic+beats+pull-request+multijob-windows\\beat\\filebeat\\label\\windows\\src\\github.com\\elastic\\beats\\filebeat\\build\\system-tests\\run\\test_registrar.Test.test_clean_removed_with_clean_inactive", "data": "C:\\Users\\jenkins\\workspace\\elastic+beats+pull-request+multijob-windows\\beat\\filebeat\\label\\windows\\src\\github.com\\elastic\\beats\\filebeat\\build\\system-tests\\run\\test_registrar.Test.test_clean_removed_with_clean_inactive\\data", "home": "C:\\Users\\jenkins\\workspace\\elastic+beats+pull-request+multijob-windows\\beat\\filebeat\\label\\windows\\src\\github.com\\elastic\\beats\\filebeat\\build\\system-tests\\run\\test_registrar.Test.test_clean_removed_with_clean_inactive", "logs": "C:\\Users\\jenkins\\workspace\\elastic+beats+pull-request+multijob-windows\\beat\\filebeat\\label\\windows\\src\\github.com\\elastic\\beats\\filebeat\\build\\system-tests\\run\\test_registrar.Test.test_clean_removed_with_clean_inactive\\logs"}, "type": "filebeat", "uuid": "da642272-27a0-4d96-8974-f5238a2fe3ce"}}}
2019-03-13T09:50:15.300Z	INFO	[beat]	instance/beat.go:831	Build info	{"system_info": {"build": {"commit": "unknown", "libbeat": "8.0.0", "time": "1754-08-30T22:43:41.128Z", "version": "8.0.0"}}}
2019-03-13T09:50:15.300Z	INFO	[beat]	instance/beat.go:834	Go runtime info	{"system_info": {"go": {"os":"windows","arch":"amd64","max_procs":4,"version":"go1.11.5"}}}
2019-03-13T09:50:15.306Z	INFO	[beat]	instance/beat.go:838	Host info	{"system_info": {"host": {"architecture":"x86_64","boot_time":"2019-02-15T04:09:37.01Z","name":"beats-ci-windows-2016-worker-x404","ip":["10.224.0.58/20","::1/128","127.0.0.1/8"],"kernel_version":"10.0.14393.2791 (rs1_release.190205-1511)","mac":["42:01:0a:e0:00:3a"],"os":{"family":"windows","platform":"windows","name":"Windows Server 2016 Datacenter","version":"10.0","major":10,"minor":0,"patch":0,"build":"14393.2791"},"timezone":"GMT","timezone_offset_sec":0,"id":"6842dd29-0e3c-4995-8486-4fa7fee5897f"}}}
2019-03-13T09:50:15.310Z	INFO	[beat]	instance/beat.go:867	Process info	{"system_info": {"process": {"cwd": "C:\\Users\\jenkins\\workspace\\elastic+beats+pull-request+multijob-windows\\beat\\filebeat\\label\\windows\\src\\github.com\\elastic\\beats\\filebeat\\tests\\system", "exe": "C:\\Users\\jenkins\\workspace\\elastic+beats+pull-request+multijob-windows\\beat\\filebeat\\label\\windows\\src\\github.com\\elastic\\beats\\filebeat\\filebeat.test.exe", "name": "filebeat.test.exe", "pid": 5112, "ppid": 4972, "start_time": "2019-03-13T09:50:15.147Z"}}}
2019-03-13T09:50:15.310Z	INFO	instance/beat.go:276	Setup Beat: filebeat; Version: 8.0.0
2019-03-13T09:50:15.311Z	DEBUG	[beat]	instance/beat.go:297	Initializing output plugins
2019-03-13T09:50:15.311Z	DEBUG	[rotator]	file/rotator.go:165	Initialized file rotator	{"rotator": {"filename": "C:\\Users\\jenkins\\workspace\\elastic+beats+pull-request+multijob-windows\\beat\\filebeat\\label\\windows\\src\\github.com\\elastic\\beats\\filebeat\\build\\system-tests\\run\\test_registrar.Test.test_clean_removed_with_clean_inactive\\output\\filebeat", "max_size_bytes": 1024000, "max_backups": 7, "permissions": "-rw-------", "interval": 0}}
2019-03-13T09:50:15.312Z	INFO	fileout/file.go:98	Initialized file output. path=C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\output\filebeat max_size_bytes=1024000 max_backups=7 permissions=-rw-------
2019-03-13T09:50:15.313Z	DEBUG	[publisher]	pipeline/consumer.go:137	start pipeline event consumer
2019-03-13T09:50:15.314Z	INFO	[publisher]	pipeline/module.go:97	Beat name: beats-ci-windows-2016-worker-x404
2019-03-13T09:50:15.315Z	ERROR	fileset/modules.go:125	Not loading modules. Module directory not found: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\module
2019-03-13T09:50:15.315Z	INFO	instance/beat.go:387	filebeat start running.
2019-03-13T09:50:15.315Z	INFO	[monitoring]	log/log.go:117	Starting metrics logging every 30s
2019-03-13T09:50:15.316Z	DEBUG	[service]	service/service_windows.go:72	Windows is interactive: false
2019-03-13T09:50:15.316Z	DEBUG	[test]	registrar/migrate.go:159	isFile(C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive/registry) -> false
2019-03-13T09:50:15.316Z	DEBUG	[test]	registrar/migrate.go:159	isFile() -> false
2019-03-13T09:50:15.316Z	DEBUG	[test]	registrar/migrate.go:152	isDir(C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\registry\filebeat) -> false
2019-03-13T09:50:15.316Z	DEBUG	[registrar]	registrar/migrate.go:51	Registry type '' found
2019-03-13T09:50:15.316Z	DEBUG	[test]	registrar/migrate.go:159	isFile(.bak) -> false
2019-03-13T09:50:15.317Z	DEBUG	[test]	registrar/migrate.go:152	isDir(C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\registry\filebeat) -> false
2019-03-13T09:50:15.317Z	INFO	registrar/migrate.go:104	No registry home found. Create: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\registry\filebeat
2019-03-13T09:50:15.317Z	INFO	service/service_windows.go:101	Attempted to register Windows service handlers, but this is not a service. No action necessary
2019-03-13T09:50:15.318Z	DEBUG	[test]	registrar/migrate.go:159	isFile(C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\registry\filebeat\meta.json) -> false
2019-03-13T09:50:15.318Z	INFO	registrar/migrate.go:112	Initialize registry meta file
2019-03-13T09:50:15.324Z	INFO	registrar/registrar.go:108	No registry file found under: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\registry\filebeat\data.json. Creating a new registry file.
2019-03-13T09:50:15.324Z	DEBUG	[registrar]	registrar/registrar.go:411	Write registry file: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\registry\filebeat\data.json (0)
2019-03-13T09:50:15.329Z	DEBUG	[registrar]	registrar/registrar.go:404	Registry file updated. 0 states written.
2019-03-13T09:50:15.330Z	INFO	registrar/registrar.go:145	Loading registrar data from C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\registry\filebeat\data.json
2019-03-13T09:50:15.330Z	INFO	registrar/registrar.go:152	States Loaded from registrar: 0
2019-03-13T09:50:15.330Z	WARN	beater/filebeat.go:357	Filebeat is unable to load the Ingest Node pipelines for the configured modules because the Elasticsearch output is not configured/enabled. If you have already loaded the Ingest Node pipelines or are using Logstash pipelines, you can ignore this warning.
2019-03-13T09:50:15.330Z	INFO	crawler/crawler.go:72	Loading Inputs: 1
2019-03-13T09:50:15.331Z	DEBUG	[registrar]	registrar/registrar.go:278	Starting Registrar
2019-03-13T09:50:15.333Z	DEBUG	[input]	log/config.go:201	recursive glob enabled
2019-03-13T09:50:15.334Z	DEBUG	[input]	log/input.go:147	exclude_files: []. Number of stats: 0
2019-03-13T09:50:15.334Z	DEBUG	[input]	log/input.go:168	input with previous states loaded: 0
2019-03-13T09:50:15.334Z	INFO	log/input.go:138	Configured paths: [C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input*]
2019-03-13T09:50:15.335Z	INFO	input/input.go:114	Starting input of type: log; ID: 15605655949473529554 
2019-03-13T09:50:15.335Z	INFO	crawler/crawler.go:106	Loading and starting Inputs completed. Enabled inputs: 1
2019-03-13T09:50:15.335Z	DEBUG	[input]	log/input.go:174	Start next scan
2019-03-13T09:50:15.336Z	DEBUG	[input]	log/input.go:404	Check file for harvesting: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input1
2019-03-13T09:50:15.337Z	DEBUG	[input]	log/input.go:477	Start harvester for new file: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input1
2019-03-13T09:50:15.338Z	DEBUG	[harvester]	log/harvester.go:493	Setting offset for file based on seek: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input1
2019-03-13T09:50:15.338Z	DEBUG	[harvester]	log/harvester.go:479	Setting offset for file: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input1. Offset: 0 
2019-03-13T09:50:15.338Z	DEBUG	[acker]	beater/acker.go:64	stateful ack	{"count": 1}
2019-03-13T09:50:15.339Z	DEBUG	[publisher]	pipeline/client.go:200	Pipeline client receives callback 'onFilteredOut' for event: %+v{0001-01-01 00:00:00 +0000 UTC null null { false 0xc000322230 C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input1 0 2019-03-13 09:50:15.3379157 +0000 GMT m=+0.173896901 1m0s log map[] 8060928-1526667-3634495929}}
2019-03-13T09:50:15.339Z	DEBUG	[registrar]	registrar/registrar.go:356	Processing 1 events
2019-03-13T09:50:15.339Z	DEBUG	[harvester]	log/harvester.go:398	Update state: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input1, offset: 0
2019-03-13T09:50:15.339Z	DEBUG	[input]	file/states.go:68	New state added for C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input1
2019-03-13T09:50:15.339Z	DEBUG	[input]	file/states.go:68	New state added for C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input1
2019-03-13T09:50:15.339Z	DEBUG	[input]	log/input.go:404	Check file for harvesting: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input2
2019-03-13T09:50:15.340Z	DEBUG	[registrar]	registrar/registrar.go:326	Registrar state updates processed. Count: 1
2019-03-13T09:50:15.340Z	DEBUG	[input]	log/input.go:477	Start harvester for new file: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input2
2019-03-13T09:50:15.340Z	DEBUG	[registrar]	registrar/registrar.go:346	Registrar states cleaned up. Before: 1, After: 1, Pending: 1
2019-03-13T09:50:15.340Z	DEBUG	[registrar]	registrar/registrar.go:411	Write registry file: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\registry\filebeat\data.json (1)
2019-03-13T09:50:15.340Z	INFO	log/harvester.go:254	Harvester started for file: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input1
2019-03-13T09:50:15.341Z	INFO	[detect_null_bytes]	debug/debug.go:95	Starting debug reader with a buffer size of 16384 and max failures of 100
2019-03-13T09:50:15.341Z	DEBUG	[harvester]	log/harvester.go:493	Setting offset for file based on seek: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input2
2019-03-13T09:50:15.341Z	DEBUG	[harvester]	log/harvester.go:479	Setting offset for file: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input2. Offset: 0 
2019-03-13T09:50:15.341Z	DEBUG	[acker]	beater/acker.go:64	stateful ack	{"count": 1}
2019-03-13T09:50:15.341Z	DEBUG	[publisher]	pipeline/client.go:200	Pipeline client receives callback 'onFilteredOut' for event: %+v{0001-01-01 00:00:00 +0000 UTC null null { false 0xc000322380 C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input2 0 2019-03-13 09:50:15.3408364 +0000 GMT m=+0.176817601 1m0s log map[] 6356992-1526672-3634495929}}
2019-03-13T09:50:15.343Z	DEBUG	[harvester]	log/harvester.go:398	Update state: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input2, offset: 0
2019-03-13T09:50:15.343Z	DEBUG	[input]	file/states.go:68	New state added for C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input2
2019-03-13T09:50:15.344Z	DEBUG	[input]	log/input.go:195	input states cleaned up. Before: 2, After: 2, Pending: 2
2019-03-13T09:50:15.344Z	DEBUG	[processors]	processing/processors.go:183	Publish event: {
  "@timestamp": "2019-03-13T09:50:15.341Z",
  "@metadata": {
    "beat": "",
    "type": "_doc",
    "version": ""
  },
  "ecs": {
    "version": "1.0.0-beta2"
  },
  "log": {
    "file": {
      "path": "C:\\Users\\jenkins\\workspace\\elastic+beats+pull-request+multijob-windows\\beat\\filebeat\\label\\windows\\src\\github.com\\elastic\\beats\\filebeat\\build\\system-tests\\run\\test_registrar.Test.test_clean_removed_with_clean_inactive\\log\\input1"
    },
    "offset": 0
  },
  "message": "file to be removed",
  "input": {
    "type": "log"
  },
  "host": {
    "name": "beats-ci-windows-2016-worker-x404"
  },
  "agent": {
    "type": "filebeat",
    "ephemeral_id": "f963203d-bd9d-4320-93a7-f82a32684026",
    "hostname": "beats-ci-windows-2016-worker-x404",
    "id": "da642272-27a0-4d96-8974-f5238a2fe3ce",
    "version": "8.0.0"
  }
}
2019-03-13T09:50:15.344Z	INFO	log/harvester.go:254	Harvester started for file: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input2
2019-03-13T09:50:15.345Z	DEBUG	[harvester]	log/log.go:102	End of file reached: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input1; Backoff now.
2019-03-13T09:50:15.345Z	INFO	[detect_null_bytes]	debug/debug.go:95	Starting debug reader with a buffer size of 16384 and max failures of 100
2019-03-13T09:50:15.346Z	DEBUG	[processors]	processing/processors.go:183	Publish event: {
  "@timestamp": "2019-03-13T09:50:15.345Z",
  "@metadata": {
    "beat": "",
    "type": "_doc",
    "version": ""
  },
  "message": "2",
  "input": {
    "type": "log"
  },
  "ecs": {
    "version": "1.0.0-beta2"
  },
  "host": {
    "name": "beats-ci-windows-2016-worker-x404"
  },
  "agent": {
    "ephemeral_id": "f963203d-bd9d-4320-93a7-f82a32684026",
    "hostname": "beats-ci-windows-2016-worker-x404",
    "id": "da642272-27a0-4d96-8974-f5238a2fe3ce",
    "version": "8.0.0",
    "type": "filebeat"
  },
  "log": {
    "file": {
      "path": "C:\\Users\\jenkins\\workspace\\elastic+beats+pull-request+multijob-windows\\beat\\filebeat\\label\\windows\\src\\github.com\\elastic\\beats\\filebeat\\build\\system-tests\\run\\test_registrar.Test.test_clean_removed_with_clean_inactive\\log\\input2"
    },
    "offset": 0
  }
}
2019-03-13T09:50:15.346Z	DEBUG	[harvester]	log/log.go:102	End of file reached: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input2; Backoff now.
2019-03-13T09:50:15.349Z	DEBUG	[registrar]	registrar/registrar.go:404	Registry file updated. 1 states written.
2019-03-13T09:50:15.349Z	DEBUG	[registrar]	registrar/registrar.go:356	Processing 1 events
2019-03-13T09:50:15.350Z	DEBUG	[input]	file/states.go:68	New state added for C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input2
2019-03-13T09:50:15.350Z	DEBUG	[registrar]	registrar/registrar.go:326	Registrar state updates processed. Count: 1
2019-03-13T09:50:15.350Z	DEBUG	[registrar]	registrar/registrar.go:346	Registrar states cleaned up. Before: 2, After: 2, Pending: 2
2019-03-13T09:50:15.350Z	DEBUG	[registrar]	registrar/registrar.go:411	Write registry file: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\registry\filebeat\data.json (2)
2019-03-13T09:50:15.358Z	DEBUG	[registrar]	registrar/registrar.go:404	Registry file updated. 2 states written.
2019-03-13T09:50:15.445Z	DEBUG	[input]	input/input.go:152	Run input
2019-03-13T09:50:15.445Z	DEBUG	[input]	log/input.go:174	Start next scan
2019-03-13T09:50:15.446Z	DEBUG	[input]	log/input.go:404	Check file for harvesting: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input1
2019-03-13T09:50:15.446Z	DEBUG	[input]	log/input.go:494	Update existing file for harvesting: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input1, offset: 20
2019-03-13T09:50:15.446Z	DEBUG	[input]	log/input.go:546	Harvester for file is still running: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input1
2019-03-13T09:50:15.447Z	DEBUG	[input]	log/input.go:404	Check file for harvesting: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input2
2019-03-13T09:50:15.447Z	DEBUG	[input]	log/input.go:494	Update existing file for harvesting: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input2, offset: 3
2019-03-13T09:50:15.447Z	DEBUG	[harvester]	log/log.go:102	End of file reached: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input1; Backoff now.
2019-03-13T09:50:15.447Z	DEBUG	[input]	log/input.go:546	Harvester for file is still running: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input2
2019-03-13T09:50:15.447Z	DEBUG	[input]	log/input.go:195	input states cleaned up. Before: 2, After: 2, Pending: 2
2019-03-13T09:50:15.447Z	DEBUG	[harvester]	log/log.go:102	End of file reached: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\log\input2; Backoff now.
2019-03-13T09:50:15.449Z	DEBUG	[publisher]	memqueue/ackloop.go:160	ackloop: receive ack [0: 0, 2]
2019-03-13T09:50:15.449Z	DEBUG	[publisher]	memqueue/eventloop.go:535	broker ACK events: count=2, start-seq=1, end-seq=2

2019-03-13T09:50:15.449Z	DEBUG	[publisher]	memqueue/ackloop.go:128	ackloop: return ack to broker loop:2
2019-03-13T09:50:15.449Z	DEBUG	[publisher]	memqueue/ackloop.go:131	ackloop:  done send ack
2019-03-13T09:50:15.449Z	DEBUG	[acker]	beater/acker.go:64	stateful ack	{"count": 2}
2019-03-13T09:50:15.449Z	DEBUG	[registrar]	registrar/registrar.go:356	Processing 2 events
2019-03-13T09:50:15.450Z	DEBUG	[registrar]	registrar/registrar.go:326	Registrar state updates processed. Count: 2
2019-03-13T09:50:15.450Z	DEBUG	[registrar]	registrar/registrar.go:346	Registrar states cleaned up. Before: 2, After: 2, Pending: 2
2019-03-13T09:50:15.450Z	DEBUG	[registrar]	registrar/registrar.go:411	Write registry file: C:\Users\jenkins\workspace\elastic+beats+pull-request+multijob-windows\beat\filebeat\label\windows\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_registrar.Test.test_clean_removed_with_clean_inactive\registry\filebeat\data.json (2)
2019-03-13T09:50:15.457Z	DEBUG	[registrar]	registrar/registrar.go:404	Registry file updated. 2 states written.

kaiyan-sheng · 2019-03-15T19:45:56Z

Just saw this happened again https://beats-ci.elastic.co/job/elastic+beats+pull-request+multijob-windows/beat=filebeat,label=windows/lastCompletedBuild/console

faec · 2019-05-02T19:02:51Z

this is also still happening on osx: https://travis-ci.org/elastic/beats/jobs/527412635

======================================================================
FAIL: Checks that files which were removed, the state is removed
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/travis/gopath/src/github.com/elastic/beats/filebeat/tests/system/test_registrar.py", line 924, in test_clean_removed_with_clean_inactive
    assert count == 1
AssertionError: 
-------------------- >> begin captured stdout << ---------------------
render config
registry size: 2
registry size after remove: 2
--------------------- >> end captured stdout << ----------------------

urso · 2020-04-30T12:48:21Z

Unfortunately the test still fails from time to time on windows.

elasticmachine · 2020-05-02T11:21:00Z

Pinging @elastic/integrations-services (Team:Services)

jlind23 · 2022-03-31T13:09:52Z

Backlog grooming: closing for now.

ruflin added Filebeat Filebeat flaky-test Unstable or unreliable test cases. labels Feb 6, 2019

ruflin added a commit to ruflin/beats that referenced this issue Feb 6, 2019

[Filebeat] Skip flaky registrar tests

ad3e202

See elastic#10606 for more details.

ruflin mentioned this issue Feb 6, 2019

[Filebeat] Skip flaky registrar tests #10607

Merged

ruflin added a commit that referenced this issue Feb 6, 2019

[Filebeat] Skip flaky registrar tests (#10607)

e6839cb

See #10606 for more details.

urso self-assigned this Feb 8, 2019

urso mentioned this issue Feb 14, 2019

Fix Registrar not removing files when clean_removed is configured #10747

Merged

urso closed this as completed Feb 26, 2019

kvch reopened this Mar 13, 2019

urso mentioned this issue Oct 4, 2019

Check if file has disappeared sooner in Log reader #13907

Merged

urso mentioned this issue Jan 23, 2020

Reenable removed tests in test_registrar #15790

Merged

8 tasks

urso closed this as completed in #15790 Jan 28, 2020

urso reopened this Apr 30, 2020

botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Apr 30, 2020

andresrc added the Team:Services (Deprecated) Label for the former Integrations-Services team label May 2, 2020

botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label May 2, 2020

andresrc added [zube]: Inbox [zube]: Backlog and removed [zube]: Inbox labels May 2, 2020

jlind23 closed this as completed Mar 31, 2022

zube bot added [zube]: Done and removed [zube]: Backlog labels Mar 31, 2022

zube bot removed the [zube]: Done label Jun 30, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Flaky Test] Filebeat test_registrar.Test.test_clean_removed_with_clean_inactive #10606

[Flaky Test] Filebeat test_registrar.Test.test_clean_removed_with_clean_inactive #10606

ruflin commented Feb 6, 2019

ruflin commented Feb 6, 2019

urso commented Feb 18, 2019

kvch commented Mar 13, 2019

kaiyan-sheng commented Mar 15, 2019

faec commented May 2, 2019

urso commented Apr 30, 2020

elasticmachine commented May 2, 2020

jlind23 commented Mar 31, 2022

[Flaky Test] Filebeat test_registrar.Test.test_clean_removed_with_clean_inactive #10606

[Flaky Test] Filebeat test_registrar.Test.test_clean_removed_with_clean_inactive #10606

Comments

ruflin commented Feb 6, 2019

Flaky Test

Artifcats

ruflin commented Feb 6, 2019

urso commented Feb 18, 2019

kvch commented Mar 13, 2019

kaiyan-sheng commented Mar 15, 2019

faec commented May 2, 2019

urso commented Apr 30, 2020

elasticmachine commented May 2, 2020

jlind23 commented Mar 31, 2022