Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Q cluster #1

Open
wants to merge 9 commits into
base: main
Choose a base branch
from
Open

Q cluster #1

wants to merge 9 commits into from

Conversation

culbert
Copy link
Collaborator

@culbert culbert commented Feb 16, 2022

Some comments:

  • The docker-compose changes are yours I believe.
  • The qcluster-deployment.yaml file is identical to the delpoyment.yaml for coldfront so, maybe, we don't need/want two different files
  • The django_q clients and workers need to use the same SECRET_KEY to encode/decode task packages so I added that to external secrets. This will need to be added to the production vault (I have not done that yet...) The client and the workers are in the same namespace so autogeneration (by something...) may be the better approach. We could also just use the oidc client secret but that's a bit "weird" for anyone trying to read the code.
  • I bumped the version of the openstack plugin and coldfront upstream in the requirements file not sure they are the ones we want to use (i.e. there may be newer tags that are more appropriate)

knikolla and others added 9 commits January 7, 2022 17:00
@knikolla
Add Q_Cluster configuration in settings and update docker-compose
c560755 
Q_Cluster configuration is only populated when the environment
variable REDIS_HOST is found.

Docker-compose spins up a development environemnt with Redis
and a coldfront instance running as a worker for Django-Q.
@knikolla
Update openstack plugin hash to pull django-q work
cd7451c
@knikolla
Update manifests to deploy Redis and QCluster
eb2b01a 
Redis is required for communication between coldfront and the
qcluster.

The qcluster is just a normal coldfront image instantiated with
the `python -m django qcluster` command.
@culbert
merge main and resolve conflicts
c2e84a6
@culbert
initial work on osn/ceph provisioning
9eccdf9
@culbert
qcluster addition
f6e2274
@culbert
cruft cleanup from devwork
fb5ee5d
@culbert
missed an edit on requirements.txt
b740160
@knikolla
Merge branch 'main' into q_cluster
31b013d
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@culbert @knikolla