Skip to content

Latest commit

 

History

History

batch_pattern

README.md

batch pattern

目的

バッチで推論を実行

前提

  • Python 3.8 以上
  • Docker
  • Docker compose

使い方

  1. カレントディレクトリ
$ pwd
~/ml-system-in-actions/chapter4_serving_patterns/batch_pattern
  1. Docker イメージをビルド
$ make build_all
# 実行されるコマンド
# docker build \
#     -t shibui/ml-system-in-actions:batch_pattern_api_0.0.1 \
#     -f Dockerfile.api \
#     .
# docker build \
#     -t shibui/ml-system-in-actions:batch_pattern_batch_0.0.1 \
#     -f Dockerfile.batch \
#     .
  1. Docker compose で各サービスを起動
$ make c_up
# 実行されるコマンド
# docker-compose \
#     -f ./docker-compose.yml \
#     up -d
  1. 起動したバッチシステムを確認
$ docker ps -a
# 出力
# CONTAINER ID   IMAGE                                                   COMMAND                  CREATED          STATUS          PORTS                               NAMES
# 08ca4db52176   shibui/ml-system-in-actions:batch_pattern_api_0.0.1     "./run.sh"               15 seconds ago   Up 14 seconds   0.0.0.0:8000->8000/tcp              api
# ab5f46b1e866   shibui/ml-system-in-actions:batch_pattern_batch_0.0.1   "python -m src.task.…"   15 seconds ago   Up 14 seconds                                       job
# d1d49ea39bf0   mysql:5.7                                               "docker-entrypoint.s…"   16 seconds ago   Up 15 seconds   0.0.0.0:3306->3306/tcp, 33060/tcp   mysql


$ docker logs job -f
# 出力
# 2021-01-30 12:41:52,739     INFO waiting for batch to start
# 2021-01-30 12:42:52,689     INFO starting batch
# 2021-01-30 12:42:52,795     INFO predict data size: 4000
# 2021-01-30 12:42:52,796    DEBUG prediction log: 4002 [4.3, 2.4, 3, 2.1] [0.13043216 0.5781998  0.29136813]
# 2021-01-30 12:42:52,798    DEBUG prediction log: 4003 [4.3, 2.4, 3, 2.1] [0.13043216 0.5781998  0.29136813]
# 2021-01-30 12:42:52,799    DEBUG prediction log: 4004 [4.3, 2.4, 3, 2.1] [0.13043216 0.5781998  0.29136813]
# 2021-01-30 12:42:52,800    DEBUG prediction log: 4005 [4, 3.9, 3, 6] [0.36126029 0.25740659 0.3813332 ]
# 2021-01-30 12:42:52,801    DEBUG prediction log: 4006 [4, 3.9, 3, 6] [0.36126029 0.25740659 0.3813332 ]
# 2021-01-30 12:42:52,807    DEBUG prediction log: 4007 [4, 3.9, 3, 6] [0.36126029 0.25740659 0.3813332 ]
# 2021-01-30 12:42:52,808    DEBUG prediction log: 4001 [4.3, 2.4, 3, 2.1] [0.13043216 0.5781998  0.29136813]
# 2021-01-30 12:42:52,808    DEBUG prediction log: 4009 [6, 3.9, 5.3, 5.7] [0.35905859 0.25630024 0.3846412 ]
  1. Docker compose を停止
$ make c_down
# 実行されるコマンド
# docker-compose \
#     -f ./docker-compose.yml \
#     down