-
Notifications
You must be signed in to change notification settings - Fork 3
Changes
Ken Suenobu edited this page Jul 22, 2018
·
40 revisions
- Added DockerTask (#54)
- Published to Bintray
- Upgraded to Scala 2.11.12
- Clean-up of tests
- Clean-up of Java Function conversion (uses implicit now)
- Added the ability to register a job by name (#51)
- Upgraded to Spark 2.3.1 - both for testing, and in code build
- Removed dependency upon
slf4j
andlogback
since they are provided inscala-logging
- Changed domain to
io.buildfactory
- Removed dependency on LazyLogging (#101)
- When adding a
SparkConf
to the cache, automatically adds base jar if missing (#102)
- Downgraded to Scala 2.11.11 for Spark/Mesos Integration (#87)
- I'm not particularly happy about this, but Spark/Mesos are built with Scala 2.11, so c'est la vie.
- Introduced a very simple implementation of a Spark Cache for Jobs (#49)
- Created
SparkTask
(#62) - Simplified use of
JobBuilder
andTaskBuilder
objects (#64) - Converted
RealWorldTest
to a Spark version (#50) - Created
scattersphere-base
module for Maven Central - name may change (#94) - Created test jar file for Spark testing (#96)
- Created a real world integration test with full Spark integration (#76)
- Added
TaskStatistics
(#67) - Added
JobStatistics
(#68) - Major Wiki updates
- Ability to pause and resume jobs (#33)
- Cancel implemented (#34)
- Slight reorganization of build scripts and documentation
- Bug fix with exception handler in
JobExecutor
, addedShellTask
(#44) - Added
RepeatingTask
(#61) - Added
DelayedTask
(#70) - Added
onStatusChange
toRunnableTask
(#71) - Added auto-incrementing
Job
ID (#31) - Added auto-incrementing
Task
ID (#30) - Several
JobExecutor
optimizations (#45) - Made
JobExecutor
less error-prone when addingJob
s and their dependencies (#57)
Licensed under the Apache License 2.0 - Lots of help from Reddit - Happy Hacking!