Skip to content

Class to simplify the search for slow and suboptimal sql queries to the database in django projects.

License

Notifications You must be signed in to change notification settings

Friskes/capture-db-queries

Repository files navigation

Class to simplify the search for slow and suboptimal sql queries to the database in django projects.

Project Status
CI/CD Latest Release
Quality Coverage
Package PyPI - Version PyPI - Support Python Versions Project PyPI - Downloads
Meta types - Mypy License - MIT code style - Ruff

About class

  • Class allows you to track any sql queries that are executed inside the body of a loop, a decorated function, or a context manager, the body can be executed a specified number of times to get the average query execution time.

  • The class allows you to display formatted output data containing brief information about the current iteration of the measurement, display sql queries and explain information on them, as well as summary information containing data on all measurements.

Do not use the class inside the business logic of your application, this will greatly slow down the execution of the queries, the class is intended only for the test environment.

Install

  1. Install package
    pip install capture-db-queries

About class parameters

All parameters are purely optional.

  • Optional parameters:
    • assert_q_count: The expected number of database queries during all number_runs, otherwise an exception will be raised: "AssertionError: N not less than or equal to N queries".
    • number_runs: The number of runs of the decorated function or test for loop.
    • verbose: Displaying the final results of test measurements within all number_runs.
    • advanced_verb: Displaying the result of each test measurement.
    • auto_call_func: Autorun of the decorated function. (without passing arguments to the function, since the launch takes place inside the class).
    • queries: Displaying colored and formatted SQL queries to the database.
    • explain: Displaying explain information about each query. (has no effect on the original query).
    • explain_opts: Parameters for explain. (for more information about the parameters for explain, see the documentation for your DBMS).
    • connection: Connecting to your database, by default: django.db.connection

Usage examples

from capture_db_queries import CaptureQueries
for ctx in CaptureQueries(number_runs=2, advanced_verb=True):
    response = self.client.get(url)

>>> Test1 | Queries count: 10 | Execution time: 0.04s
>>> Test2 | Queries count: 10 | Execution time: 0.04s
>>> Tests count: 2  |  Total queries count: 20  |  Total execution time: 0.08s  |  Median time one test is: 0.041s  |  Vendor: sqlite

OR

@CaptureQueries(number_runs=2, advanced_verb=True)
def test_request():
    response = self.client.get(url)

>>> Test1 | Queries count: 10 | Execution time: 0.04s
>>> Test2 | Queries count: 10 | Execution time: 0.04s
>>> Tests count: 2  |  Total queries count: 20  |  Total execution time: 0.08s  |  Median time one test is: 0.041s  |  Vendor: sqlite

OR

# NOTE: The with context manager does not support multi-launch number_runs > 1
with CaptureQueries(number_runs=1, advanced_verb=True) as ctx:
    response = self.client.get(url)

>>> Queries count: 10  |  Execution time: 0.04s  |  Vendor: sqlite

Example of output when using queries and explain:

for _ in CaptureQueries(advanced_verb=True, queries=True, explain=True):
    list(Reporter.objects.filter(pk=1))
    list(Article.objects.filter(pk=1))

>>> Test1 | Queries count: 2 | Execution time: 0.22s
>>>
>>>
>>> №[1] time=[0.109] explain=['2 0 0 SEARCH TABLE tests_reporter USING INTEGER PRIMARY KEY (rowid=?)']
>>> SELECT "tests_reporter"."id",
>>>     "tests_reporter"."full_name"
>>> FROM "tests_reporter"
>>> WHERE "tests_reporter"."id" = 1
>>>
>>>
>>> №[2] time=[0.109] explain=['2 0 0 SEARCH TABLE tests_article USING INTEGER PRIMARY KEY (rowid=?)']
>>> SELECT "tests_article"."id",
>>>     "tests_article"."pub_date",
>>>     "tests_article"."headline",
>>>     "tests_article"."content",
>>>     "tests_article"."reporter_id"
>>> FROM "tests_article"
>>> WHERE "tests_article"."id" = 1
>>>
>>>
>>> Tests count: 1  |  Total queries count: 2  |  Total execution time: 0.22s  |  Median time one test is: 0.109s  |  Vendor: sqlite