Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable multithreading with several operations in combine/select/transform #2574

Merged
merged 23 commits into from
Jan 21, 2021
Merged

Enable multithreading with several operations in combine/select/transform #2574

Show file tree
Hide file tree
Changes from 3 commits
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
6594e78
Spawn one task per operation
nalimilan Dec 2, 2020
8e29048
Fix handling of idx_agg and order of columns
nalimilan Dec 5, 2020
2ca83f9
Use threading in another loop
nalimilan Dec 6, 2020
b9eb025
Remove redundant idx handling
nalimilan Dec 12, 2020
487fce7
Support Julia 1.0
nalimilan Dec 12, 2020
78106ea
tmp
nalimilan Dec 12, 2020
97090f4
idx_agg can't be nothing
nalimilan Dec 12, 2020
801e54e
Use default exception handling
nalimilan Dec 12, 2020
688e7c3
Add test
nalimilan Dec 13, 2020
a3dd7fd
Add @sync
nalimilan Dec 13, 2020
4a12320
Fix exception type
nalimilan Dec 20, 2020
adf35bf
More robust exception handling
nalimilan Dec 21, 2020
aed32c4
Fix Julia 1.0
nalimilan Dec 21, 2020
e442ce5
Typo
nalimilan Dec 22, 2020
6d96c2a
Add `@spawn` test
nalimilan Dec 23, 2020
38b2511
Call GC.safepoint every 100_000 rows
nalimilan Jan 16, 2021
542cd1c
Review fixes
nalimilan Jan 17, 2021
fec4aae
Merge branch 'main' into nl/threadedops
nalimilan Jan 17, 2021
4ceddf5
Add mention in the manual
nalimilan Jan 17, 2021
a0ce364
Fix Julia 1.0
nalimilan Jan 17, 2021
c7b3cee
Add comment
nalimilan Jan 20, 2021
e1a0222
Improve docs
nalimilan Jan 20, 2021
76a7a21
Use multiple threads on CI, warn if not
nalimilan Jan 20, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion src/DataFrames.jl
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ module DataFrames
using Statistics, Printf, REPL
using Reexport, SortingAlgorithms, Compat, Unicode, PooledArrays
@reexport using Missings, InvertedIndices
using Base.Sort, Base.Order, Base.Iterators
using Base.Sort, Base.Order, Base.Iterators, Base.Threads
using TableTraits, IteratorInterfaceExtensions
import LinearAlgebra: norm
using Markdown
Expand Down
Loading