Skip to content

Commit

Permalink
Add info about classes and types to 'getting started' docs (#6557)
Browse files Browse the repository at this point in the history
Co-authored-by: 97littleleaf11 <[email protected]>
Co-authored-by: Jingchen Ye <[email protected]>
Co-authored-by: AlexWaygood <[email protected]>
  • Loading branch information
4 people authored May 7, 2022
1 parent 269adee commit 91e890f
Show file tree
Hide file tree
Showing 4 changed files with 121 additions and 28 deletions.
2 changes: 2 additions & 0 deletions docs/source/class_basics.rst
Original file line number Diff line number Diff line change
@@ -1,3 +1,5 @@
.. _class-basics:

Class basics
============

Expand Down
136 changes: 109 additions & 27 deletions docs/source/getting_started.rst
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ Getting started
===============

This chapter introduces some core concepts of mypy, including function
annotations, the :py:mod:`typing` module, library stubs, and more.
annotations, the :py:mod:`typing` module, stub files, and more.

Be sure to read this chapter carefully, as the rest of the documentation
may not make much sense otherwise.
Expand Down Expand Up @@ -317,28 +317,119 @@ syntax like so:
# If you're using Python 3.6+
my_global_dict: Dict[int, float] = {}
.. _stubs-intro:
Library stubs and typeshed
**************************
Types and classes
*****************

So far, we've only seen examples of pre-existing types like the ``int``
or ``float`` builtins, or generic types from ``collections.abc`` and
``typing``, such as ``Iterable``. However, these aren't the only types you can
use: in fact, you can use any Python class as a type!

For example, suppose you've defined a custom class representing a bank account:

.. code-block:: python
class BankAccount:
# Note: It is ok to omit type hints for the "self" parameter.
# Mypy will infer the correct type.
def __init__(self, account_name: str, initial_balance: int = 0) -> None:
# Note: Mypy will infer the correct types of your fields
# based on the types of the parameters.
self.account_name = account_name
self.balance = initial_balance
def deposit(self, amount: int) -> None:
self.balance += amount
def withdraw(self, amount: int) -> None:
self.balance -= amount
def overdrawn(self) -> bool:
return self.balance < 0
You can declare that a function will accept any instance of your class
by simply annotating the parameters with ``BankAccount``:

.. code-block:: python
def transfer(src: BankAccount, dst: BankAccount, amount: int) -> None:
src.withdraw(amount)
dst.deposit(amount)
account_1 = BankAccount('Alice', 400)
account_2 = BankAccount('Bob', 200)
transfer(account_1, account_2, 50)
In fact, the ``transfer`` function we wrote above can accept more then just
instances of ``BankAccount``: it can also accept any instance of a *subclass*
of ``BankAccount``. For example, suppose you write a new class that looks like this:

.. code-block:: python
class AuditedBankAccount(BankAccount):
def __init__(self, account_name: str, initial_balance: int = 0) -> None:
super().__init__(account_name, initial_balance)
self.audit_log: list[str] = []
Mypy uses library *stubs* to type check code interacting with library
modules, including the Python standard library. A library stub defines
a skeleton of the public interface of the library, including classes,
variables and functions, and their types. Mypy ships with stubs for
the standard library from the `typeshed
<https://github.com/python/typeshed>`_ project, which contains library
stubs for the Python builtins, the standard library, and selected
third-party packages.
def deposit(self, amount: int) -> None:
self.audit_log.append(f"Deposited {amount}")
self.balance += amount
For example, consider this code:
def withdraw(self, amount: int) -> None:
self.audit_log.append(f"Withdrew {amount}")
self.balance -= amount
Since ``AuditedBankAccount`` is a subclass of ``BankAccount``, we can directly pass
in instances of it into our ``transfer`` function:

.. code-block:: python
x = chr(4)
audited = AuditedBankAccount('Charlie', 300)
transfer(account_1, audited, 100) # Type checks!
This behavior is actually a fundamental aspect of the PEP 484 type system: when
we annotate some variable with a type ``T``, we are actually telling mypy that
variable can be assigned an instance of ``T``, or an instance of a *subclass* of ``T``.
The same rule applies to type hints on parameters or fields.

See :ref:`class-basics` to learn more about how to work with code involving classes.


.. _stubs-intro:

Stubs files and typeshed
************************

Without a library stub, mypy would have no way of inferring the type of ``x``
and checking that the argument to :py:func:`chr` has a valid type.
Mypy also understands how to work with classes found in the standard library.
For example, here is a function which uses the ``Path`` object from the
`pathlib standard library module <https://docs.python.org/3/library/pathlib.html>`_:

.. code-block:: python
from pathlib import Path
def load_template(template_path: Path, name: str) -> str:
# Mypy understands that 'file_path.read_text()' returns a str...
template = template_path.read_text()
# ...so understands this line type checks.
return template.replace('USERNAME', name)
This behavior may surprise you if you're familiar with how
Python internally works. The standard library does not use type hints
anywhere, so how did mypy know that ``Path.read_text()`` returns a ``str``,
or that ``str.replace(...)`` accepts exactly two ``str`` arguments?

The answer is that mypy comes bundled with *stub files* from the
the `typeshed <https://github.com/python/typeshed>`_ project, which
contains stub files for the Python builtins, the standard library,
and selected third-party packages.

A *stub file* is a file containing a skeleton of the public interface
of that Python module, including classes, variables, functions -- and
most importantly, their types.

Mypy complains if it can't find a stub (or a real module) for a
library module that you import. Some modules ship with stubs or inline
Expand All @@ -349,7 +440,7 @@ the stubs for the ``requests`` package like this:

.. code-block:: shell
python3 -m pip install types-requests
$ python3 -m pip install types-requests
The stubs are usually packaged in a distribution named
``types-<distribution>``. Note that the distribution name may be
Expand All @@ -363,17 +454,8 @@ often suggest the name of the stub distribution:
prog.py:1: note: Hint: "python3 -m pip install types-PyYAML"
...
.. note::

Starting in mypy 0.900, most third-party package stubs must be
installed explicitly. This decouples mypy and stub versioning,
allowing stubs to updated without updating mypy. This also allows
stubs not originally included with mypy to be installed. Earlier
mypy versions included a fixed set of stubs for third-party
packages.

You can also :ref:`create
stubs <stub-files>` easily. We discuss ways of silencing complaints
stubs <stub-files>` easily. We discuss strategies for handling errors
about missing stubs in :ref:`ignore-missing-imports`.

Configuring mypy
Expand Down
9 changes: 9 additions & 0 deletions docs/source/installed_packages.rst
Original file line number Diff line number Diff line change
Expand Up @@ -33,6 +33,15 @@ you can create such packages.
example), it is recommended that you also pin the versions of all
your stub package dependencies.

.. note::

Starting in mypy 0.900, most third-party package stubs must be
installed explicitly. This decouples mypy and stub versioning,
allowing stubs to updated without updating mypy. This also allows
stubs not originally included with mypy to be installed. Earlier
mypy versions included a fixed set of stubs for third-party
packages.

Using installed packages with mypy (PEP 561)
********************************************

Expand Down
2 changes: 1 addition & 1 deletion docs/source/running_mypy.rst
Original file line number Diff line number Diff line change
Expand Up @@ -322,7 +322,7 @@ this error, try:
In some rare cases, you may get the "Cannot find implementation or library
stub for module" error even when the module is installed in your system.
This can happen when the module is both missing type hints and is installed
on your system in a unconventional way.
on your system in an unconventional way.

In this case, follow the steps above on how to handle
:ref:`missing type hints in third party libraries <missing-type-hints-for-third-party-library>`.
Expand Down

0 comments on commit 91e890f

Please sign in to comment.