Code

Do not do rereading step in fread#2558

Code

Merged

st-pasha merged 40 commits intomasterh2oai/datatable:masterfrom ps-typebumpsh2oai/datatable:ps-typebumpsCopy head branch name to clipboardAug 6, 2020

+759-450

Commits

Commits on Jul 28, 2020

• Rename ordered_task -> OrderedTask

  st-pasha

  committed
  5714801

• Rename wait_task -> WaitTask

  st-pasha

  committed
  e9c9ee8

• Rename ordered_scheduler -> OrderedJob

  st-pasha

  committed
  690c245

• Orderedjob member variables with _'s

  st-pasha

  committed
  4ef8873

• OrderedJob.tasks_ is now a vector of unique_ptr's

  st-pasha

  committed
  e33e29e

• Rename class thread_team -> ThreadTeam

  st-pasha

  committed
  3a7da2c

• Create new implementation of parallel_for_ordered() loop

  st-pasha

  committed
  c372d6b

• Use new ordered loop in generate_string_column()

  st-pasha

  committed
  230a9b1

Commits on Jul 29, 2020

• Simplify map_str2str()

  st-pasha

  committed
  76d27ed

• Use new parallel_for_ordered2() in test_parallel_for_ordered()

  st-pasha

  committed
  8c5abc5

• Use parallel_for_ordered2() in test_progress_ordered

  st-pasha

  committed
  9abf6aa

• Use new parallel_for_ordered2 in write_to_csv

  st-pasha

  committed
  80a086c

• job_->abort_execution() is superfluous

  st-pasha

  committed
  403935f

• Use new parallel_for_ordered2 in fread

  st-pasha

  committed
  c399ba8

• Remove old code and final renames

  st-pasha

  committed
  59b7abf

• Introduce local types in Parallel reader

  st-pasha

  committed
  f096efb

Commits on Jul 31, 2020

• Merge branch 'master' into ps-typebumps

  st-pasha

  committed
  ac05c04

• tests for parallel ordered loop moved into separate file

  st-pasha

  committed
  a35aa49

• Added tests for throwing exceptions in an ordered loop

  st-pasha

  committed
  8d465ca

• WaitTask -> NoopTask

  st-pasha

  committed
  edb5951

• Added a test for set_num_iterations()

  st-pasha

  committed
  a8adeec

• Added test for wait_until_all_finalized()

  st-pasha

  committed
  c3dbd8c

• Add a test for single-threaded set_num_iters()

  st-pasha

  committed
  46b582b

Commits on Aug 1, 2020

• Added a noop test for parallel ordered loop

  st-pasha

  committed
  487c68b

• Added method OrderedTask::super_ordered()

  st-pasha

  committed
  ad9af5f

• Simplify wait_until_all_finalized()

  st-pasha

  committed
  eb97d8e

Commits on Aug 3, 2020

• Inline ParallelReader::order_chunk()

  st-pasha

  committed
  295eb07

Commits on Aug 4, 2020

• Perform on-the-fly type bumps in fread

  st-pasha

  committed
  b756851

• Cleanup some of the 'type-bumping' logic

  st-pasha

  committed
  4feb656

• Removed "Prepare for re-reading"

  st-pasha

  committed
  993c54b

• Remove is_in_buffer()

  st-pasha

  committed
  8abc9f9

• More cleanup

  st-pasha

  committed
  5022a9b

Commits on Aug 5, 2020

• Remove OutputColumn::present_in_buffer flag

  st-pasha

  committed
  7a467ec

• Restore stats calculation in fread

  st-pasha

  committed
  a887974

• ignore iris.xls.zip in tests

  st-pasha

  committed
  965943a

• do not report skipped files in large fread test

  st-pasha

  committed
  3475efe

• remove WORK_REREAD

  st-pasha

  committed
  41e1e20

• Remove reread stats from FreadObserver

  st-pasha

  committed
  ca4d84a

• remove commented-out code

  st-pasha

  committed
  6ca460f

Commits on Aug 6, 2020

• Remove -Wno-implicit-int-float-conversion flag, not portable

  st-pasha

  committed
  9f5b6aa