Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge Develop #176

Merged
merged 111 commits into from
Oct 1, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
111 commits
Select commit Hold shift + click to select a range
9a81c34
[WIP] implement microtvm_gvsoc target
PhilippvK Jan 10, 2023
4f9ef92
feature.py: RunFeatures can not enable subprocesses
PhilippvK Jan 12, 2024
f7bbf57
WIP: add new features and postprocesses for validate_new
PhilippvK Jan 12, 2024
8036b3f
frontends.py: fix typo in process_metadata
PhilippvK Jan 12, 2024
aea3130
run.py: allow process_metadata to return artifacts
PhilippvK Jan 12, 2024
b0fc7ed
WIP: add new features and postprocesses for validate_new
PhilippvK Jan 12, 2024
a87b42a
fix print_top dtype
PhilippvK Jan 15, 2024
d9a91f7
add quant/dequant details to model_info
PhilippvK Jan 15, 2024
4d4c98c
WIP: add new features and postprocesses for validate_new
PhilippvK Jan 15, 2024
3ffc3c6
add assertion to SimpleFrontend
PhilippvK Jan 15, 2024
fb4a217
WIP: add new features and postprocesses for validate_new (tvm platform)
PhilippvK Jan 15, 2024
59c89dc
fix print_top dtype 2
PhilippvK Jan 15, 2024
2e10d31
WIP: add new features and postprocesses for validate_new (validate_ou…
PhilippvK Jan 15, 2024
bb5d710
WIP: add new features and postprocesses for validate_new
PhilippvK Jan 16, 2024
c8b0fab
tvmc_utils: disable print_top by default
PhilippvK Jan 16, 2024
d497193
WIP: add new features and postprocesses for validate_new (mlif)
PhilippvK Jan 16, 2024
844020c
WIP: add new features and postprocesses for validate_new (tvm)
PhilippvK Jan 16, 2024
9a23c7f
tvmc_utils: disable print_top by default 2
PhilippvK Jan 16, 2024
119e13c
WIP: add new features and postprocesses for validate_new (postproc at…
PhilippvK Jan 16, 2024
fec58b4
target/common.yml: Allow overriding stdout encoding for execute utility
PhilippvK Jan 16, 2024
a2426f5
target/common.py: Add stdin_data argument (needs live=False)
PhilippvK Jan 16, 2024
3a0679b
target.exec may return artifacts now
PhilippvK Jan 16, 2024
3ee0b4b
target.py: add utils for choosing io interfaces
PhilippvK Jan 16, 2024
10c1106
Add ValidationNew.md
PhilippvK Jan 16, 2024
0f6c948
Update ValidationNew.md
PhilippvK Jan 16, 2024
06e08a7
Update ValidationNew.md
PhilippvK Jan 16, 2024
6ec8090
tflite frontend: add inference method
PhilippvK Jan 17, 2024
c132768
continue working on gen_ref_data feature
PhilippvK Jan 17, 2024
603b1a5
tflite frontend: prints (WIP)
PhilippvK Jan 17, 2024
87610a3
continue working on gen_ref_data feature 2
PhilippvK Jan 17, 2024
c6b20aa
validate_outputs: set rtol=0 for testing
PhilippvK Jan 17, 2024
67048ca
tflite frontend: extract model info from tflite file if definition.ym…
PhilippvK Jan 17, 2024
9553d0f
update md
PhilippvK Jan 17, 2024
6f26688
mlif: support generated model_support files for validation feature
PhilippvK Jan 24, 2024
969543f
implement mlif template versioning
PhilippvK Jan 24, 2024
4e323cb
mlif_target: fix batch size calculation
PhilippvK Jan 24, 2024
3c91733
mlif_target: cleanup interface selection code
PhilippvK Jan 24, 2024
8971790
handle mlif_iunvalid_size error correctly
PhilippvK Jan 24, 2024
1e90d0e
pass user/env config to ModelHints
PhilippvK Jan 24, 2024
b25cbd9
mlif: support generated model_support files for validation feature
PhilippvK Jan 24, 2024
6a6da26
move ModelSupport code into separate class and file
PhilippvK Jan 24, 2024
69665a4
mlif.py: add missing imports
PhilippvK Jan 25, 2024
f642c68
update validation readme
PhilippvK Jan 25, 2024
77347a9
fix typo in mlonmcu/models/frontend.py
PhilippvK Jan 25, 2024
7e0f9ae
update validation readme
PhilippvK Jan 25, 2024
577d0a5
update validation readme
PhilippvK Jan 25, 2024
676d75e
update validation readme
PhilippvK Jan 28, 2024
09aeafd
fix typo in gen_ref_data property
PhilippvK Jan 28, 2024
725ac5d
fixes
PhilippvK Feb 28, 2024
0e839e1
validate_outputs: add experimental pm1 metric
PhilippvK Mar 20, 2024
3668400
frontends: move generation of inout data to different methods
PhilippvK Mar 31, 2024
f1c75e4
frontends: allow overriding model-specific paths
PhilippvK Mar 31, 2024
4345db5
lint code
PhilippvK Mar 31, 2024
1a8d9eb
move validate metrics to seperate class & file
PhilippvK Apr 9, 2024
bc24886
platforms: add mlif.needs_model_support
PhilippvK Apr 11, 2024
65233fd
lint
PhilippvK Apr 11, 2024
607c5c6
fix merge artifact
PhilippvK Apr 11, 2024
5f198eb
lint
PhilippvK Apr 11, 2024
ab3017a
add missing file
PhilippvK Apr 11, 2024
77f2a40
mlif: fixes
PhilippvK May 23, 2024
95c1dd8
postprocesses: add missing registrations
PhilippvK May 23, 2024
c6b3e94
postprocesses: fix typo
PhilippvK May 23, 2024
2e61212
postprocesses: improve validate_outputs
PhilippvK May 23, 2024
4ec9d7f
postprocesses: implement export_outputs
PhilippvK May 23, 2024
8cc27b3
postprocess fixes
PhilippvK May 23, 2024
6966e7e
utils.execute: fixes for stdin_data feature
PhilippvK May 23, 2024
e7f1be1
models: convert support_path, inputs_path & outputs_path to pathlib.Path
PhilippvK May 24, 2024
69c974b
postprocess fixes
PhilippvK May 24, 2024
d8d6269
frontends: add assertion msg
PhilippvK May 27, 2024
d040b1b
rm print
PhilippvK May 27, 2024
71e7280
introduce new feature: GenRefLabels
PhilippvK May 27, 2024
c64bdc3
introduce new feature: GenRefLabels 2
PhilippvK May 27, 2024
983989e
frontend: handle dtype ranges
PhilippvK May 27, 2024
9a15a32
frontend: fix assertions
PhilippvK May 27, 2024
86d7aa9
frontends: find handling of aww input shift
PhilippvK May 27, 2024
7b435d9
introduce new feature: GenRefLabels 3
PhilippvK May 27, 2024
916f38a
introduce validate_labels postprocess
PhilippvK May 27, 2024
79baeda
introduce classify metrics
PhilippvK May 27, 2024
852736e
validate_outputs: add validate_range option (on by default) 2
PhilippvK May 27, 2024
65499ca
run: add error message if not frontend can be initialized
PhilippvK May 27, 2024
cbff929
update validate_metrics
PhilippvK May 28, 2024
9196ede
Merge remote-tracking branch 'origin/main' into refactor-validate-reb…
PhilippvK May 29, 2024
cbc5a15
lint code
PhilippvK May 29, 2024
73e945b
lint code 2
PhilippvK May 29, 2024
ed66f54
t# This is a combination of 2 commits.
PhilippvK May 25, 2024
7cde237
etiss: add comments on simple_mem_system.memseg_mode_*
PhilippvK May 25, 2024
5bb5600
etiss: move rom start
PhilippvK May 25, 2024
37c54be
etiss: add option for running etiss directly, e.g. without run_helper.sh
PhilippvK May 29, 2024
635a85d
refactor etiss target and add more cfgs
PhilippvK May 29, 2024
4e6e0c5
ci: update actions to latest versions
PhilippvK Aug 27, 2024
81a128b
ci: update actions to latest versions
PhilippvK Aug 27, 2024
d97d338
Merge branch 'develop' into refactor-validate-rebased3
PhilippvK Sep 9, 2024
97b3553
features: comment out unimplemented get_postprocesses
PhilippvK Sep 9, 2024
a6a38c2
features: add docstrings to validation features
PhilippvK Sep 9, 2024
40e90fe
features: cleanup comments
PhilippvK Sep 9, 2024
34e0e5d
tvm_target: rm prints
PhilippvK Sep 9, 2024
d9d6a97
lint
PhilippvK Sep 9, 2024
3771909
Merge pull request #158 from tum-ei-eda/refactor-validate-rebased
PhilippvK Sep 9, 2024
3d6e678
Merge pull request #162 from tum-ei-eda/etiss-updates
PhilippvK Sep 9, 2024
454a1df
Merge branch 'develop' into feature-microtvm-gvsoc-template
PhilippvK Sep 9, 2024
aefd537
lint
PhilippvK Sep 9, 2024
0254467
Merge pull request #100 from tum-ei-eda/feature-microtvm-gvsoc-template
PhilippvK Sep 9, 2024
7138957
fix microtvm_gvsoc_target.py typo
PhilippvK Sep 9, 2024
2fd53f0
dev.yml.j2: update tflite-micro ref
PhilippvK Sep 12, 2024
9c9ef0e
corev.yml.j2: update mlif ref
PhilippvK Sep 12, 2024
e61699f
mlif: support ccache
PhilippvK Sep 26, 2024
3609918
mlif: assert that llvm.install_dir exists
PhilippvK Sep 26, 2024
9efdcb4
templates: use fixes branch for polybench fork
PhilippvK Sep 27, 2024
3a15a04
Polybench: allow passing dataset size
PhilippvK Sep 27, 2024
c7599df
dev.yml.j2: update mlif ref
PhilippvK Sep 27, 2024
7495fad
add support for openasip example models
PhilippvK Feb 26, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions .github/workflows/bench.yml
Original file line number Diff line number Diff line change
Expand Up @@ -36,11 +36,11 @@ jobs:
matrix:
python-version: ["3.10"]
steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
with:
submodules: recursive
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v4
uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python-version }}
# TODO: caching
Expand Down Expand Up @@ -76,7 +76,7 @@ jobs:
cd scripts/
python bench.py ${{ github.event.inputs.benchmark }} out/
- name: Archive reports
uses: actions/upload-artifact@v2
uses: actions/upload-artifact@v4
with:
name: results
path: scripts/out/
Expand Down
30 changes: 15 additions & 15 deletions .github/workflows/cicd.yml
Original file line number Diff line number Diff line change
Expand Up @@ -44,12 +44,12 @@ jobs:
matrix:
python-version: ["3.7", "3.8", "3.9", "3.10", "3.11"]
steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v4
uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python-version }}
- uses: actions/cache@v3
- uses: actions/cache@v4
id: cache-venv # name for referring later
with:
path: |
Expand Down Expand Up @@ -84,12 +84,12 @@ jobs:
python-version: ["3.10"]
if: github.ref == 'refs/heads/main' || startsWith(github.ref, 'refs/tags/v')
steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v4
uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python-version }}
- uses: actions/cache@v3
- uses: actions/cache@v4
id: cache-venv # name for referring later
with:
path: |
Expand All @@ -100,7 +100,7 @@ jobs:
restore-keys: |
build-${{ runner.os }}-${{ matrix.python-version }}-venv-${{ hashFiles('**/requirements*.txt') }}
- name: Archive package
uses: actions/upload-artifact@v2
uses: actions/upload-artifact@v4
with:
name: mlonmcu
path: dist/
Expand All @@ -118,12 +118,12 @@ jobs:
matrix:
python-version: ["3.10"]
steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v4
uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python-version }}
- uses: actions/cache@v3
- uses: actions/cache@v4
id: cache-venv # name for referring later
with:
path: |
Expand Down Expand Up @@ -156,7 +156,7 @@ jobs:
source .venv/bin/activate
make coverage-full
- name: Archive code coverage html report
uses: actions/upload-artifact@v2
uses: actions/upload-artifact@v4
with:
name: code-coverage-report
path: htmlcov
Expand All @@ -182,12 +182,12 @@ jobs:
matrix:
python-version: ["3.10"]
steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v4
uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python-version }}
- uses: actions/cache@v3
- uses: actions/cache@v4
id: cache-venv # name for referring later
with:
path: |
Expand Down Expand Up @@ -215,7 +215,7 @@ jobs:
source .venv/bin/activate
make docs
- name: Deploy docs
uses: peaceiris/actions-gh-pages@v3
uses: peaceiris/actions-gh-pages@v4
if: ${{ github.ref == 'refs/heads/main' }}
with:
github_token: ${{ secrets.GITHUB_TOKEN }}
Expand Down
46 changes: 23 additions & 23 deletions .github/workflows/container.yml
Original file line number Diff line number Diff line change
Expand Up @@ -52,15 +52,15 @@ jobs:
remove-haskell: 'true'
remove-codeql: 'true'
- name: Checkout
uses: actions/checkout@v3
uses: actions/checkout@v4
with:
submodules: recursive
- name: Set up QEMU
uses: docker/setup-qemu-action@v2
uses: docker/setup-qemu-action@v3
- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v2
uses: docker/setup-buildx-action@v3
- name: Login to GitHub Container Registry
uses: docker/login-action@v2
uses: docker/login-action@v3
with:
registry: ghcr.io
username: ${{ github.actor }}
Expand All @@ -70,11 +70,11 @@ jobs:
./scripts/update_version.sh
- name: Lowercase repository url
id: lowered
uses: ASzc/change-string-case-action@v5
uses: ASzc/change-string-case-action@v6
with:
string: ${{ github.repository }}
- name: Build and push (CMake)
uses: docker/build-push-action@v4
uses: docker/build-push-action@v6
with:
context: .
file: docker/Dockerfile
Expand All @@ -88,7 +88,7 @@ jobs:
cache-to: type=inline
tags: ghcr.io/${{ steps.lowered.outputs.lowercase }}-cmake:${{ github.event.inputs.version }}
- name: Build and push
uses: docker/build-push-action@v4
uses: docker/build-push-action@v6
with:
context: .
file: docker/Dockerfile
Expand Down Expand Up @@ -118,15 +118,15 @@ jobs:
remove-haskell: 'true'
remove-codeql: 'true'
- name: Checkout
uses: actions/checkout@v3
uses: actions/checkout@v4
with:
submodules: recursive
- name: Set up QEMU
uses: docker/setup-qemu-action@v2
uses: docker/setup-qemu-action@v3
- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v2
uses: docker/setup-buildx-action@v3
- name: Login to GitHub Container Registry
uses: docker/login-action@v2
uses: docker/login-action@v3
with:
registry: ghcr.io
username: ${{ github.actor }}
Expand All @@ -136,11 +136,11 @@ jobs:
./scripts/update_version.sh
- name: Lowercase repository url
id: lowered
uses: ASzc/change-string-case-action@v5
uses: ASzc/change-string-case-action@v6
with:
string: ${{ github.repository }}
# - name: Build and push
# uses: docker/build-push-action@v4
# uses: docker/build-push-action@v6
# with:
# context: .
# file: docker/Dockerfile
Expand All @@ -153,14 +153,14 @@ jobs:
# cache-to: type=inline
# tags: ghcr.io/${{ steps.lowered.outputs.lowercase }}:${{ github.event.inputs.version }}
- name: Login to DockerHub
uses: docker/login-action@v2
uses: docker/login-action@v3
if: ${{ github.repository == 'tum-ei-eda/mlonmcu' }}
with:
registry: ${{ secrets.DOCKER_REGISTRY }}
username: ${{ secrets.DOCKER_USERNAME }}
password: ${{ secrets.DOCKER_PASSWORD }}
- name: Build and push to Docker Hub
uses: docker/build-push-action@v4
uses: docker/build-push-action@v6
if: ${{ github.repository == 'tum-ei-eda/mlonmcu' }}
with:
context: .
Expand Down Expand Up @@ -192,26 +192,26 @@ jobs:
remove-haskell: 'true'
remove-codeql: 'true'
- name: Checkout
uses: actions/checkout@v3
uses: actions/checkout@v4
with:
submodules: recursive
- name: Set up QEMU
uses: docker/setup-qemu-action@v2
uses: docker/setup-qemu-action@v3
- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v2
uses: docker/setup-buildx-action@v3
- name: Login to GitHub Container Registry
uses: docker/login-action@v2
uses: docker/login-action@v3
with:
registry: ghcr.io
username: ${{ github.actor }}
password: ${{ secrets.GITHUB_TOKEN }}
- name: Lowercase repository url
id: lowered
uses: ASzc/change-string-case-action@v5
uses: ASzc/change-string-case-action@v6
with:
string: ${{ github.repository }}
# - name: Build and push
# uses: docker/build-push-action@v4
# uses: docker/build-push-action@v6
# with:
# context: .
# file: docker/Dockerfile
Expand All @@ -227,14 +227,14 @@ jobs:
# cache-to: type=inline
# tags: ghcr.io/${{ steps.lowered.outputs.lowercase }}-bench:${{ github.event.inputs.version }}
- name: Login to DockerHub
uses: docker/login-action@v2
uses: docker/login-action@v3
if: ${{ github.repository == 'tum-ei-eda/mlonmcu' }}
with:
registry: ${{ secrets.DOCKER_REGISTRY }}
username: ${{ secrets.DOCKER_USERNAME }}
password: ${{ secrets.DOCKER_PASSWORD }}
- name: Build and push to Docker Hub
uses: docker/build-push-action@v4
uses: docker/build-push-action@v6
if: ${{ github.repository == 'tum-ei-eda/mlonmcu' }}
with:
context: .
Expand Down
42 changes: 21 additions & 21 deletions .github/workflows/container_weekly.yml
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ jobs:
id: timestamp
- name: Lowercase repository url
id: lowered
uses: ASzc/change-string-case-action@v5
uses: ASzc/change-string-case-action@v6
with:
string: ${{ github.repository }}
- name: CFG
Expand Down Expand Up @@ -109,21 +109,21 @@ jobs:
remove-haskell: 'true'
remove-codeql: 'true'
- name: Checkout
uses: actions/checkout@v3
uses: actions/checkout@v4
with:
ref: ${{ steps.cfg.outputs.branch }}
- name: Set up QEMU
uses: docker/setup-qemu-action@v2
uses: docker/setup-qemu-action@v3
- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v2
uses: docker/setup-buildx-action@v3
- name: Login to GitHub Container Registry
uses: docker/login-action@v2
uses: docker/login-action@v3
with:
registry: ghcr.io
username: ${{ github.actor }}
password: ${{ secrets.GITHUB_TOKEN }}
- name: Build and push (CMake)
uses: docker/build-push-action@v4
uses: docker/build-push-action@v6
with:
context: .
file: docker/Dockerfile
Expand All @@ -138,7 +138,7 @@ jobs:
cache-to: type=inline
tags: ghcr.io/${{ steps.lowered.outputs.lowercase }}-cmake:latest
- name: Build and push
uses: docker/build-push-action@v4
uses: docker/build-push-action@v6
with:
context: .
file: docker/Dockerfile
Expand Down Expand Up @@ -166,7 +166,7 @@ jobs:
id: timestamp
- name: Lowercase repository url
id: lowered
uses: ASzc/change-string-case-action@v5
uses: ASzc/change-string-case-action@v6
with:
string: ${{ github.repository }}
- name: CFG
Expand Down Expand Up @@ -228,28 +228,28 @@ jobs:
remove-haskell: 'true'
remove-codeql: 'true'
- name: Checkout
uses: actions/checkout@v3
uses: actions/checkout@v4
with:
ref: ${{ steps.cfg.outputs.branch }}
- name: Set up QEMU
uses: docker/setup-qemu-action@v2
uses: docker/setup-qemu-action@v3
- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v2
uses: docker/setup-buildx-action@v3
- name: Login to GitHub Container Registry
uses: docker/login-action@v2
uses: docker/login-action@v3
with:
registry: ghcr.io
username: ${{ github.actor }}
password: ${{ secrets.GITHUB_TOKEN }}
- name: Login to DockerHub
uses: docker/login-action@v2
uses: docker/login-action@v3
if: ${{ github.repository == 'tum-ei-eda/mlonmcu' }}
with:
registry: ${{ secrets.DOCKER_REGISTRY }}
username: ${{ secrets.DOCKER_USERNAME }}
password: ${{ secrets.DOCKER_PASSWORD }}
- name: Build and push to Docker Hub
uses: docker/build-push-action@v4
uses: docker/build-push-action@v6
if: ${{ github.repository == 'tum-ei-eda/mlonmcu' }}
with:
context: .
Expand Down Expand Up @@ -278,7 +278,7 @@ jobs:
id: timestamp
- name: Lowercase repository url
id: lowered
uses: ASzc/change-string-case-action@v5
uses: ASzc/change-string-case-action@v6
with:
string: ${{ github.repository }}
- name: CFG
Expand Down Expand Up @@ -340,28 +340,28 @@ jobs:
remove-haskell: 'true'
remove-codeql: 'true'
- name: Checkout
uses: actions/checkout@v3
uses: actions/checkout@v4
with:
ref: ${{ steps.cfg.outputs.branch }}
- name: Set up QEMU
uses: docker/setup-qemu-action@v2
uses: docker/setup-qemu-action@v3
- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v2
uses: docker/setup-buildx-action@v3
- name: Login to GitHub Container Registry
uses: docker/login-action@v2
uses: docker/login-action@v3
with:
registry: ghcr.io
username: ${{ github.actor }}
password: ${{ secrets.GITHUB_TOKEN }}
- name: Login to DockerHub
uses: docker/login-action@v2
uses: docker/login-action@v3
if: ${{ github.repository == 'tum-ei-eda/mlonmcu' }}
with:
registry: ${{ secrets.DOCKER_REGISTRY }}
username: ${{ secrets.DOCKER_USERNAME }}
password: ${{ secrets.DOCKER_PASSWORD }}
- name: Build and push to Docker Hub
uses: docker/build-push-action@v4
uses: docker/build-push-action@v6
if: ${{ github.repository == 'tum-ei-eda/mlonmcu' }}
with:
context: .
Expand Down
Loading
Loading