Real Python

The Real Python Podcast – Episode #54: Building a Neural Network and How to Write Tests in Python

2021-04-02T12:00:00+00:00

Do you know how a neural network functions? What goes into building one from scratch using Python? This week on the show, David Amos is back, and he's brought another batch of PyCoder's Weekly articles and projects.

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Python Community Interview With Will McGugan

2021-03-31T14:00:00+00:00

Today I’m joined by Will McGugan. Will is a freelance Python developer based in Scotland and the creator of the popular Python library Rich.

In this interview, we discuss the origins of Rich, what it’s like to maintain a popular Python package, building chess engines, and Will’s love of photography.

Ricky: Thanks for joining me for this interview, Will. I’d like to start in the same manner we do with all our guests: how did you get into programming, and when did you start using Python?

Will: Thanks for having me on!

I discovered programming as a kid in the ’80s. For younger readers, it was exactly like Stranger Things, minus the CGI monsters. We had a ZX Spectrum+ computer back then. The graphics were flickery, and the sound was tinny, but I was hooked. At some point I discovered that you could type things on the keyboard and—if you did it just right—the computer would do as you told it.

Fast-forward a few years, and I’m working in the video games industry. I’m building a game engine and looking for a scripting language to handle the game mechanics while C++ does the graphics and heavy lifting. That’s when I came across Python, version 2.1, I think.

I didn’t consider it a proper programming language at the time, probably because it was too easy to use, and programming should be hard, right? Even so, I found myself coming back to Python for scripts and tools, which gradually became more sophisticated.

Read the full article at https://realpython.com/interview-will-mcgugan/ »

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Understanding Python List Comprehensions

2021-03-30T14:00:00+00:00

One of Python’s most distinctive features is the list comprehension, which you can use to create powerful functionality within a single line of code. However, many developers struggle to fully leverage the more advanced features, or use them too much, which can lead to code that’s less efficient and harder to read.

By the end of this course, you’ll understand the full power of Python list comprehensions and how to use their features comfortably. You’ll also gain an understanding of the trade-offs that come with using them so that you can determine when other approaches are more preferable.

In this course, you’ll learn how to:

Rewrite loops and map() calls as a list comprehension in Python
Choose between comprehensions, loops, and map() calls
Supercharge your comprehensions with conditional logic
Use comprehensions to replace filter()
Profile your code to solve performance questions

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

OrderedDict vs dict in Python: The Right Tool for the Job

2021-03-29T14:00:00+00:00

Sometimes you need a Python dictionary that remembers the order of its items. In the past, you had only one tool for solving this specific problem: Python’s OrderedDict. It’s a dictionary subclass specially designed to remember the order of items, which is defined by the insertion order of keys.

This changed in Python 3.6. The built-in dict class now keeps its items ordered as well. Because of that, many in the Python community now wonder if OrderedDict is still useful. A closer look at OrderedDict will uncover that this class still provides valuable features.

In this tutorial, you’ll learn how to:

Create and use OrderedDict objects in your code
Identify the differences between OrderedDict and dict
Understand the pros and cons of using OrderedDict vs dict

With this knowledge, you’ll able to choose the dictionary class that best fits your needs when you want to preserve the order of items.

By the end of the tutorial, you’ll see an example of implementing a dictionary-based queue using OrderedDict, which would be more challenging if you used a regular dict object.

Free Bonus: Click here to get a Python Cheat Sheet and learn the basics of Python 3, like working with data types, dictionaries, lists, and Python functions.

Choosing Between `OrderedDict` and `dict`

For years, Python dictionaries were unordered data structures. Python developers were used to this fact, and they relied on lists or other sequences when they needed to keep their data in order. With time, developers found a need for a new type of dictionary, one that would keep its items ordered.

Back in 2008, PEP 372 introduced the idea of adding a new dictionary class to collections. Its main goal was to remember the order of items as defined by the order in which keys were inserted. That was the origin of OrderedDict.

Core Python developers wanted to fill in the gap and provide a dictionary that could preserve the order of inserted keys. That, in turn, allowed for a more straightforward implementation of specific algorithms that rely on this property.

OrderedDict was added to the standard library in Python 3.1. Its API is essentially the same as dict. However, OrderedDict iterates over keys and values in the same order that the keys were inserted. If a new entry overwrites an existing entry, then the order of items is left unchanged. If an entry is deleted and reinserted, then it will be moved to the end of the dictionary.

Python 3.6 introduced a new implementation of dict. This new implementation represents a big win in terms of memory usage and iteration efficiency. Additionally, the new implementation provides a new and somewhat unexpected feature: dict objects now keep their items in the same order they were introduced. Initially, this feature was considered an implementation detail, and the documentation advised against relying on it.

Note: In this tutorial, you’ll focus on the implementations of dict and OrderedDict that CPython provides.

In the words of Raymond Hettinger, core Python developer and coauthor of OrderedDict, the class was specially designed to keep its items ordered, whereas the new implementation of dict was designed to be compact and to provide fast iteration:

The current regular dictionary is based on the design I proposed several years ago. The primary goals of that design were compactness and faster iteration over the dense arrays of keys and values. Maintaining order was an artifact rather than a design goal. The design can maintain order but that is not its specialty.

In contrast, I gave collections.OrderedDict a different design (later coded in C by Eric Snow). The primary goal was to have efficient maintenance of order even for severe workloads such as that imposed by the lru_cache which frequently alters order without touching the underlying dict. Intentionally, the OrderedDict has a design that prioritizes ordering capabilities at the expense of additional memory overhead and a constant factor worse insertion time.

It is still my goal to have collections.OrderedDict have a different design with different performance characteristics than regular dicts. It has some order specific methods that regular dicts don’t have (such as a move_to_end() and a popitem() that pops efficiently from either end). The OrderedDict needs to be good at those operations because that is what differentiates it from regular dicts. (Source)

In Python 3.7, the items-ordered feature of dict objects was declared an official part of the Python language specification. So, from that point on, developers could rely on dict when they needed a dictionary that keeps its items ordered.

At this point, a question arises: Is OrderedDict still needed after this new implementation of dict? The answer depends on your specific use case and also on how explicit you want to be in your code.

At the time of writing, some features of OrderedDict still made it valuable and different from a regular dict:

Intent signaling: If you use OrderedDict over dict, then your code makes it clear that the order of items in the dictionary is important. You’re clearly communicating that your code needs or relies on the order of items in the underlying dictionary.
Control over the order of items: If you need to rearrange or reorder the items in a dictionary, then you can use .move_to_end() and also the enhanced variation of .popitem().
Equality test behavior: If your code compares dictionaries for equality, and the order of items is important in that comparison, then OrderedDict is the right choice.

There’s at least one more reason to continue using OrderedDict in your code: backward compatibility. Relying on regular dict objects to preserve the order of items will break your code in environments that run versions of Python older than 3.6.

It’s difficult to say if dict will fully replace OrderedDict soon. Nowadays, OrderedDict still offers interesting and valuable features that you might want to consider when selecting a tool for a given job.

Getting Started With Python’s `OrderedDict`

Python’s OrderedDict is a dict subclass that preserves the order in which key-value pairs, commonly known as items, are inserted into the dictionary. When you iterate over an OrderedDict object, items are traversed in the original order. If you update the value of an existing key, then the order remains unchanged. If you remove an item and reinsert it, then the item is added at the end of the dictionary.

Being a dict subclass means that it inherits all the methods a regular dictionary provides. OrderedDict also has additional features that you’ll learn about in this tutorial. In this section, however, you’ll learn the basics of creating and using OrderedDict objects in your code.

Read the full article at https://realpython.com/python-ordereddict/ »

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

The Real Python Podcast – Episode #53: Improving the Learning Experience on Real Python

2021-03-26T12:00:00+00:00

If you haven't visited the website lately, then you're missing out on the updates to realpython.com! The site features a completely refreshed layout with multiple sections to help you take advantage of even more great educational Python content. This week on the show, we have Dan Bader, the person behind Real Python, and all these architectural changes.

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Python Community Interview With Dane Hillard

2021-03-24T14:00:00+00:00

Today I’m joined by Dane Hillard, lead web application developer at ITHAKA and author of Practices of the Python Pro. Dane is also a Real Python tutorial author.

In this interview, we discuss a variety of topics, including code complexity, Python package maintenance, and popcorn. So without further ado, let’s welcome Dane.

Ricky: Thanks for joining me for this interview, Dane. I’d like to start in the same manner we do with all our guests: how did you get into programming, and when did you start using Python?

Dane: Thanks for having me back! Real Python is a pretty nice place to spend some more time. Some of my first experiences with programming were the same for a lot of kids from the era of LiveJournal and MySpace—I was regularly customizing my profile page and theme to make sure my angsty ramblings looked their best.

Around the same time, I started doing some 3D modeling in Rhinoceros as a mostly artistic outlet, but it also offered some scripting capabilities that I tinkered with. A friend and I got pretty into Liero, and I went so far as to make a few custom weapons for us to play with. So in all, a geeky start coming out of a few tangential interests.

I learned C++ and MATLAB in school and spent my first internship and full-time job working in those languages. I picked up Perl along the way and managed to land my second job using it.

While learning a massive amount about SQL optimization there, I also started tinkering on some side projects with a friend. He was a big Rails guy, so I started getting exposure to Ruby. I’d been using PHP and then Spring to run a website for my photography and decided to give Rails a try next. The “coding by convention” paradigm didn’t quite click with me at that time.

Read the full article at https://realpython.com/interview-dane-hillard/ »

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Records and Sets: Selecting the Ideal Data Structure

2021-03-23T14:00:00+00:00

There are a variety of ways for storing and managing data in your program and the choice of the right data structure has an effect on the readability of your code, ease of writing, and performance. Python has a wide selection of built-in mechanisms that meet most of your data structure needs. This course introduces you to two types of data structures: data records and sets.

There are multiple types and classes for both of these data structures and this course discusses them and provides information on how to choose the right one.

In this course you’ll learn about:

What are the advantages of using the built-in dict type as a Data Record
What flexibility do DataClasses add for Records compared to regular Classes
How to store C-type Data with struct.Struct
How to define Sets
Where to use a Frozenset
How to create a counter with a multiset

The course is the second part of an ongoing series, exploring how to find the right Data Structure for your projects. The first course is Dictionaries and Arrays: Selecting the Ideal Data Structure.

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Build an Asteroids Game With Python and Pygame

2021-03-22T14:00:00+00:00

Do you want to create your own computer games but like Python too much to abandon it for a career as a game developer? There’s a solution for that! With the Pygame module, you can use your amazing Python skills to create games, from the basic to the very complex. Below, you’ll learn how to use Pygame by making a clone of the Asteroids game!

In this tutorial, you’ll learn how to build a complete game, including:

Loading images and displaying them on the screen
Handling user input in order to control the game
Moving objects according to the game logic
Detecting collisions between object
Displaying text on the screen
Playing sounds

Click the link below to download the code for this project and follow along as you build your game:

Get the Source Code: Click here to get the source code you’ll use to build an Asteroids game in Python with Pygame in this tutorial.

Let’s get started!

Demo: Asteroids Game in Python

The game you’ll be making is a clone of the classic arcade game Asteroids. In it, you control a spaceship and shoot asteroids. If your spaceship collides with an asteroid, you lose. If you shoot down all asteroids, you win!

Project Overview

Your Asteroids game in Python will feature a single spaceship. The spaceship can rotate left and right as well as accelerate forward. When it’s not accelerating, it will continue moving with the velocity it had. The spaceship can also shoot bullets.

The game will use the following key mappings:

Key	Action
`Right`	Rotate the spaceship right
`Left`	Rotate the spaceship left
`Up`	Accelerate the spaceship forward
`Space`	Shoot
`Esc`	Exit the game

There will also be six big asteroids in the game. When a bullet hits a big asteroid, it will split into two medium ones. When a bullet hits a medium asteroid, it will split into two small ones. A small asteroid won’t split but will be destroyed by a bullet.

When an asteroid collides with the spaceship, the spaceship will be destroyed, and the game will end in a defeat. When all asteroids are gone, the game will end in a victory!

The project will be broken into ten steps:

Setting up Pygame for a Python project
Handing input in the game
Loading images and showing them on the screen
Creating game objects with an image, a position, and some logic
Moving the spaceship
Moving the asteroids and detecting collisions with the spaceship
Shooting bullets and destroying asteroids
Splitting asteroids into smaller ones
Playing sounds
Handling the end of the game

Each step will provide links to all necessary resources.

Prerequisites

To build your Asteroids game, you’ll need some more advanced elements of Python. You should already be comfortable with the language itself as well as with concepts like classes, inheritance, and callbacks. If you need to refresh your knowledge on these topics, then check our Object-Oriented Programming (OOP) in Python 3.

The game will also use vectors to represent positions and directions, as well as some vector operations to move the elements on the screen. Pygame will take care of most of the math, and all the necessary concepts will be explained in this tutorial. However, if you want to know more, then you can check out Vector Addition.

The Pygame documentation can be useful if you want to understand some concepts in depth, but you’ll find everything you need to know in this tutorial.

Step 1: Pygame Setup

At the end of this step, you’ll have a small Python project that uses Pygame. It will display a window with a caption, filled with a blue color. This will be first step toward your Asteroids game. You won’t need any specific game development tools. Your favorite text editor and the command line will be enough.

Python Project

Read the full article at https://realpython.com/asteroids-game-python/ »

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

The Real Python Podcast – Episode #52: Connecting to MongoDB and Updates on the Python Packaging Landscape

2021-03-19T12:00:00+00:00

Have you heard about NoSQL databases, or wondered how to use one with Python? How does MongoDB store information and what packages can you use to connect this type of database to your Python project? This week on the show, David Amos is back, and he's brought another batch of PyCoder's Weekly articles and projects.

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Python AI: How to Build a Neural Network & Make Predictions

2021-03-17T14:00:00+00:00

If you’re just starting out in the artificial intelligence (AI) world, then Python is a great language to learn since most of the tools are built using it. Deep learning is a technique used to make predictions using data, and it heavily relies on neural networks. Today, you’ll learn how to build a neural network from scratch.

In a production setting, you would use a deep learning framework like TensorFlow or PyTorch instead of building your own neural network. That said, having some knowledge of how neural networks work is helpful because you can use it to better architect your deep learning models.

In this tutorial, you’ll learn:

What artificial intelligence is
How both machine learning and deep learning play a role in AI
How a neural network functions internally
How to build a neural network from scratch using Python

Let’s get started!

Free Bonus: Click here to get access to a free NumPy Resources Guide that points you to the best tutorials, videos, and books for improving your NumPy skills.

Artificial Intelligence Overview

In basic terms, the goal of using AI is to make computers think as humans do. This may seem like something new, but the field was born in the 1950s.

Imagine that you need to write a Python program that uses AI to solve a sudoku problem. A way to accomplish that is to write conditional statements and check the constraints to see if you can place a number in each position. Well, this Python script is already an application of AI because you programmed a computer to solve a problem!

Machine learning (ML) and deep learning (DL) are also approaches to solving problems. The difference between these techniques and a Python script is that ML and DL use training data instead of hard-coded rules, but all of them can be used to solve problems using AI. In the next sections, you’ll learn more about what differentiates these two techniques.

Machine Learning

Machine learning is a technique in which you train the system to solve a problem instead of explicitly programming the rules. Getting back to the sudoku example in the previous section, to solve the problem using machine learning, you would gather data from solved sudoku games and train a statistical model. Statistical models are mathematically formalized ways to approximate the behavior of a phenomenon.

A common machine learning task is supervised learning, in which you have a dataset with inputs and known outputs. The task is to use this dataset to train a model that predicts the correct outputs based on the inputs. The image below presents the workflow to train a model using supervised learning:

Workflow to train a machine learning model

The combination of the training data with the machine learning algorithm creates the model. Then, with this model, you can make predictions for new data.

Note: scikit-learn is a popular Python machine learning library that provides many supervised and unsupervised learning algorithms. To learn more about it, check out Split Your Dataset With scikit-learn’s train_test_split().

The goal of supervised learning tasks is to make predictions for new, unseen data. To do that, you assume that this unseen data follows a probability distribution similar to the distribution of the training dataset. If in the future this distribution changes, then you need to train your model again using the new training dataset.

Feature Engineering

Prediction problems become harder when you use different kinds of data as inputs. The sudoku problem is relatively straightforward because you’re dealing directly with numbers. What if you want to train a model to predict the sentiment in a sentence? Or what if you have an image, and you want to know whether it depicts a cat?

Another name for input data is feature, and feature engineering is the process of extracting features from raw data. When dealing with different kinds of data, you need to figure out ways to represent this data in order to extract meaningful information from it.

An example of a feature engineering technique is lemmatization, in which you remove the inflection from words in a sentence. For example, inflected forms of the verb “watch,” like “watches,” “watching,” and “watched,” would be reduced to their lemma, or base form: “watch.”

If you’re using arrays to store each word of a corpus, then by applying lemmatization, you end up with a less-sparse matrix. This can increase the performance of some machine learning algorithms. The following image presents the process of lemmatization and representation using a bag-of-words model:

Creating features using a bag-of-words model

First, the inflected form of every word is reduced to its lemma. Then, the number of occurrences of that word is computed. The result is an array containing the number of occurrences of every word in the text.

Deep Learning

Read the full article at https://realpython.com/python-ai-neural-network/ »

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Python Booleans: Leveraging the Values of Truth

2021-03-16T14:00:00+00:00

Understanding how Python Boolean values behave is important to programming well in Python. The Python Boolean type is one of Python’s built-in data types. It’s used to represent the truth value of an expression. For example, the expression 1 <= 2 is True, while the expression 0 == 1 is False.

In this course, you’ll learn how to:

Use Python Booleans to write efficient and readable Python code
Manipulate Boolean values with Boolean operators
Convert Booleans to other types
Convert other types to Python Booleans

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Python Community Interview With Ewa Jodlowska

2021-03-15T14:00:00+00:00

Today I’m joined by Ewa Jodlowska, executive director of the Python Software Foundation (PSF), the organization devoted to advancing open source technology related to the Python programming language.

In this interview, we discuss how Ewa started her tech journey, how COVID-19 affected the PSF, plans for PyCon US 2021, her love of hiking and lifting weights, and much more.

Ricky: Thank you for joining me, Ewa. You’ve been at the PSF for over nine years at this point, first as the events coordinator, then as the director of operations, and now as the executive director. I’m curious to know a little about your background, how you found your way in the PSF, and why you’re so passionate about Python.

Ewa: That is a great question—and not one I get asked often!

I was first introduced to PyCon through my previous employer, where I was a meeting planner, account manager, and eventually a software engineer! We were contracted in 2008 to help out in several ways: We helped with logistical conference planning and eventually built a registration site for PyCon and managed hotel reservations. Back then, we were programming using PHP and Informix 4GL.

I implemented many first-time registration functionalities, such as how people signed up for tutorials! Of course, PyCon has its own system now, but the flow of it is still based on what was created for PyCon 2009.

Going to PyCon in 2008 and 2009 inspired me to get my CS degree through night school. Even though it didn’t offer any Python courses, it helped uncover more of the tech scene for me.

In 2011 I left my previous employer to adventure around Europe for a couple of years, and the PSF offered me a part-time position to work on PyCon! By June of 2012 I was offered full-time employment since PyCon really took off when it was in Santa Clara, California. A couple months later, the PSF’s part-time administrator left, and that responsibility was added to my role.

Through that role I received a lot of exposure to what the PSF did outside of PyCon and our wonderful community. From that time, the PSF really began to flourish, and the support we provided (and continue to provide) to the Python community continued to evolve.

Read the full article at https://realpython.com/interview-ewa-jodlowska/ »

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

The Real Python Podcast – Episode #51: Navigating Options for Deploying Your Python Application

2021-03-12T12:00:00+00:00

What goes into the decision of how to host your Python code or application in the cloud? Which technology stack is the right size for your project? This week on the show, we have Calvin Hendryx-Parker. Calvin talks about cloud hosting options, infrastructure choices, and deployment tools.

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Build a Contact Book With Python, PyQt, and SQLite

2021-03-10T14:00:00+00:00

Building projects is arguably one of the more approachable and effective ways of learning to program. Real projects require you to apply different and varied coding skills. They also encourage you to research topics that pop up as you’re solving problems in the development process. In this tutorial, you’ll create a contact book application with Python, PyQt, and SQLite.

In this tutorial, you’ll learn how to:

Create a graphical user interface (GUI) for your contact book application using Python and PyQt
Connect the application to an SQLite database using PyQt’s SQL support
Manage contact data using PyQt’s Model-View architecture

At the end of this project, you’ll have a functional contact book application that will allow you to store and manage your contact information.

To get the complete source code for the application as well as the code for every step you’ll go through in this tutorial, click the link below:

Get the Source Code: Click here to get the source code you’ll use to build a contact book with Python, PyQt, and SQLite in this tutorial.

Demo: A Contact Book With Python

Contact books are a useful and widely used kind of application. They’re everywhere. You probably have a contact book on your phone and on your computer. With a contact book, you can store and manage contact information for your family members, friends, coworkers, and so on.

In this tutorial, you’ll code a contact book GUI application with Python, SQLite, and PyQt. Here’s a demo of how your contact book will look and work after you follow the steps in this tutorial:

Your contact book will provide the minimal required set of features for this kind of application. You’ll be able to display, create, update, and remove the information in your contacts list.

Project Overview

To build your contact book application, you need to organize the code into modules and packages and give your project a coherent structure. In this tutorial, you’ll use the following directories and files structure:

rpcontacts_project/
│
├── rpcontacts/
│   ├── __init__.py
│   ├── views.py
│   ├── database.py
│   ├── main.py
│   └── model.py
│
├── requirements.txt
├── README.md
└── rpcontacts.py

Here’s a brief summary of the contents of your project directory:

rpcontacts_project/ is the project’s root directory. It’ll contain the following files:
- requirements.txt provides the project’s requirements list.
- README.md provides general information about the project.
- rpcontacts.py provides the entry-point script to run the application.
rpcontacts/ is a subdirectory that provides the application’s main package. It provides the following modules:
- __init__.py
- views.py
- database.py
- main.py
- model.py

You’ll cover each of these files step by step in this tutorial. The name of each file gives an idea of its role in the application. For example, views.py will contain the code to generate the GUI of windows and dialogs, database.py will contain code to work with the database, and main.py will host the application itself. Finally, model.py will implement the model to manage the data in the application’s database.

In general, the application will have a main window to display, add, remove, and update contacts. It’ll also have a dialog to add new contacts to the database.

Prerequisites

To get the most out of this project, some previous knowledge of GUI programming with Python and PyQt would help. In this regard, you’ll need to know the basics of how to:

Create GUI applications with PyQt and Python
Build and lay out GUIs with PyQt
Manage SQL databases with Python and PyQt
Work with SQLite databases

To brush up on these topics, you can check out the following resources:

Don’t worry if you’re not an expert in these areas before starting this tutorial. You’ll learn through the process of getting your hands dirty on a real project. If you get stuck, then take your time and review the resources linked above. Then get back to the code.

The contact book application you’re going to build in this tutorial has a single external dependency: PyQt.

Read the full article at https://realpython.com/python-contact-book/ »

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Django View Authorization: Restricting Access

2021-03-09T14:00:00+00:00

Django provides tools for both authentication and authorization. Django view authorization is typically done with decorators. This course will show you how to use these view decorators to enforce authorized viewing of pages in your Django site.

By the end of this course you’ll know how to:

Use HttpRequest and HttpRequest.user objects
Authenticate and authorize users
Differentiate between regular, staff, and admin users
Secure a view with the @login_required decorator
Restrict a view to different roles with the @user_passes_test decorator
Use the Django messages framework to notify your users

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

The Real Python Podcast: It's Been a Year!

2021-03-08T14:00:00+00:00

This week, the Real Python Podcast is reaching its fiftieth episode!

It’s been quite a year, full of sharing and learning and connecting in the Python community. We’re looking forward to bringing you more interesting guests, interviews with expert Pythonistas, and lots of behind-the-scenes with the Real Python team.

Here’s a quick look at some of what’s been going on with the podcast in the past year as well as a sneak peek at what’s to come!

Free Bonus: Click here to get a Python Cheat Sheet and learn the basics of Python 3, like working with data types, dictionaries, lists, and Python functions.

PyCon Speakers Shared Their Expertise

PyCon is an important hub for the Python community, so we absolutely had to bring you the experts who are sharing their expertise at this conference. Here are some of the speakers you heard from this past year:

Read the full article at https://realpython.com/real-python-podcast-first-year/ »

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

The Real Python Podcast – Episode #50: Consuming APIs With Python and Building Microservices With gRPC

2021-03-05T12:00:00+00:00

Have you wanted to get your Python code to consume data from web-based APIs? Maybe you've dabbled with the requests package, but you don't know what steps to take next. This week on the show, David Amos is back, and he's brought another batch of PyCoder's Weekly articles and projects.

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

New Features: Article Bookmarks, Completion Status, and Search Improvements

2021-03-03T14:00:00+00:00

With close to 2,000 Python tutorials and video lessons in the Real Python content library, it was getting harder and harder for learners to find the right resources at the right time.

To fix that, we’ve just launched out several new features to help you easily find and review the learning resources you’re looking for.

Here’s what’s new:

Article Completion Status and Bookmarks

Just like with courses and course lessons, you can now bookmark written tutorials and mark them as completed to track your learning progress.

This makes it super easy to save tutorials you want to read, or to keep tutorials you found valuable around for future reference:

Read the full article at https://realpython.com/article-bookmarks-search-improvements/ »

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Navigating Namespaces and Scope in Python

2021-03-02T14:00:00+00:00

In a program of any complexity, you’ll create hundreds or thousands of names, each pointing to a specific object. How does Python keep track of all these names so that they don’t interfere with one another? This course covers Python namespaces, the structures used to organize the symbolic names assigned to objects in a Python program.

In this course, you’ll learn:

How Python organizes symbolic names and objects in namespaces
When Python creates a new namespace
How namespaces are implemented
How variable scope determines symbolic name visibility
What is the LEGB rule

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Python and MongoDB: Connecting to NoSQL Databases

2021-03-01T16:59:25+00:00

MongoDB is a document-oriented and NoSQL database solution that provides great scalability and flexibility along with a powerful querying system. With MongoDB and Python, you can develop many different types of database applications quickly. So if your Python application needs a database that’s just as flexible as the language itself, then MongoDB is for you.

In this tutorial, you’ll learn:

What MongoDB is
How to install and run MongoDB
How to work with MongoDB databases
How to use the low-level PyMongo driver to interface with MongoDB
How to use the high-level MongoEngine object-document mapper (ODM)

Throughout this tutorial, you’ll write a couple of examples that will demonstrate the flexibility and power of MongoDB and its great Python support. To download the source code for those examples, click the link below:

Get the Source Code: Click here to get the source code you’ll use to learn about using MongoDB with Python in this tutorial.

Using SQL vs NoSQL Databases

For decades, SQL databases were one of the only choices for developers looking to build large and scalable database systems. However, the increasing need for storing complex data structures led to the birth of NoSQL databases. This new kind of database system allows developers to store heterogeneous and structureless data efficiently.

In general, NoSQL database systems store and retrieve data in a much different way from SQL relational database management systems (RDBMSs).

When it comes to choosing from the currently available database technologies, you might need to decide between using SQL or NoSQL systems. Both of them have specific features that you should consider when choosing one or the other. Here are some of their more substantial differences:

Property	SQL Databases	NoSQL Databases
Data model	Relational	Nonrelational
Structure	Table-based, with columns and rows	Document based, key-value pairs, graph, or wide-column
Schema	A predefined and strict schema in which every record (row) is of the same nature and possesses the same properties	A dynamic schema or schemaless which means that records don’t need to be of the same nature
Query language	Structured Query Language (SQL)	Varies from database to database
Scalability	Vertical	Horizontal
ACID transactions	Supported	Supported, depending on the specific NoSQL database
Ability to add new properties	Need to alter the schema first	Possible without disturbing anything

There are many other differences between the two types of databases, but those mentioned above are some of the more important ones to know about.

When choosing a database, you should consider its strengths and weaknesses carefully. You also need to consider how the database fits into your specific scenario and your application’s requirements. Sometimes the right solution is to use a combination of SQL and NoSQL databases to handle different aspects of a broader system.

Some common examples of SQL databases include:

NoSQL database examples include:

In recent years, SQL and NoSQL databases have even begun to merge. For example, database systems, such as PostgreSQL, MySQL, and Microsoft SQL Server now support storing and querying JSON data, much like NoSQL databases. With this, you can now achieve many of the same results with both technologies. But you still don’t get many of the NoSQL features, such as horizontal scaling and the user-friendly interface.

With this brief background on SQL and NoSQL databases, you can focus on the main topic of this tutorial: the MongoDB database and how to use it in Python.

Managing NoSQL Databases With MongoDB

MongoDB is a document-oriented database classified as NoSQL. It’s become popular throughout the industry in recent years and integrates extremely well with Python. Unlike traditional SQL RDBMSs, MongoDB uses collections of documents instead of tables of rows to organize and store data.

MongoDB stores data in schemaless and flexible JSON-like documents. Here, schemaless means that you can have documents with a different set of fields in the same collection, without the need for satisfying a rigid table schema.

You can change the structure of your documents and data over time, which results in a flexible system that allows you to quickly adapt to requirement changes without the need for a complex process of data migration. However, the trade-off in changing the structure of new documents is that exiting documents become inconsistent with the updated schema. So this is a topic that needs to be managed with care.

Note: JSON stands for JavaScript Object Notation. It’s a file format with a human-readable structure consisting of key-value pairs that can be nested arbitrarily deep.

MongoDB is written in C++ and actively developed by MongoDB Inc. It runs on all major platforms, such as macOS, Windows, Solaris, and most Linux distributions. In general, there are three main development goals behind the MongoDB database:

Scale well
Store rich data structures
Provide a sophisticated query mechanism

Read the full article at https://realpython.com/introduction-to-mongodb-and-python/ »

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

The Real Python Podcast – Episode #49: The Challenges of Developing Into a Python Professional

2021-02-26T12:00:00+00:00

What's the difference between writing code for yourself and developing for others? What new considerations do you need to take into account as a professional Python developer? This week on the show, we talk to Dane Hillard about his book "Practices of the Python Pro".

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Dictionaries and Arrays: Selecting the Ideal Data Structure

2021-02-23T14:00:00+00:00

There are a variety of ways of storing and managing data in your Python programs, and the choice of the right data structure will affect the readability of your code, ease of writing, and performance. Python has a wide variety of built-in mechanisms that meet most of your data structure needs.

This course introduces you to two types of data structures: dictionaries and arrays. There are multiple types and classes for both of these data structures and this course discusses them and provides information on how to choose the ideal one.

In this course you’ll learn about:

What are the advantages of using the built-in dict type
What are four other types of dictionaries
How list and tuple types are arrays
What are typed arrays and how can they save memory
How strings are arrays and what that implies
What are the different arrays for storing binary data
What are the practical uses for the different types
How to select the ideal data structure for your programs

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

The Real Python Podcast – Episode #48: Stochastic Gradient Descent and Deploying Your Python Scripts on the Web

2021-02-19T12:00:00+00:00

Do you know the initial steps to get your Python script hosted on the web? You may have built something with Flask, but how would you stand it up so that you can share it with others? This week on the show, we have the previous guest Martin Breuss back on the show. Martin shares his recent article titled, "Python Web Applications: Deploy Your Script as a Flask App". David Amos also returns, and he's brought another batch of PyCoder's Weekly articles and projects.

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Creating PyQt Layouts for GUI Applications

2021-02-16T14:00:00+00:00

PyQt’s layout managers provide a user-friendly and productive way of arranging graphical components, or widgets, on a GUI. Laying out widgets properly will make your GUI applications look polished and professional. Learning to do so efficiently and effectively is a fundamental skill for you to get up and running with GUI application development using Python and PyQt.

In this course, you’ll learn:

What the benefits are of using PyQt’s layout managers
How to programmatically lay out widgets on a GUI using PyQt’s layout managers
How to select the right layout manager for your GUI application
How to lay out widgets in main window–based and dialog-based applications

For a better understanding of how to use layout managers, some previous knowledge of how to create PyQt GUI applications and how to work with PyQt widgets would be helpful.

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

The Real Python Podcast – Episode #47: Unraveling Python's Syntax to Its Core With Brett Cannon

2021-02-12T12:00:00+00:00

Do you feel like you understand how Python works under the hood? What is syntactic sugar, and how much of it should be in Python? This week on the show, we have Brett Cannon. Brett is a Python core developer and he's been working on a series of articles where he is unraveling the syntax of Python. His series is a fantastic resource for those wanting to learn how Python is structured and works at its core.

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Python Modulo: Using the % Operator

2021-02-09T14:00:00+00:00

Python supports a wide range of arithmetic operators that you can use when working with numbers in your code. One of these operators is the modulo operator (%), which returns the remainder of dividing two numbers. Modular operations are useful to check if a number is even or odd, simplifying cycling through data, and doing non-decimal based units conversion.

In this course, you’ll learn:

How modulo works in mathematics
How to use the Python modulo operator with different numeric types
How Python calculates the results of a modulo operation
How to override .__mod__() in your classes to use them with the modulo operator
How to use the Python modulo operator to solve real-world problems

The code in this course was tested with Python 3.9.0, % has not change much and older versions should be compatible.

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

The Real Python Podcast – Episode #46: C for Python Developers and Data Visualization With Dash

2021-02-05T12:00:00+00:00

Are you interested in building interactive dashboards with Python? How about a project that takes a flat data file all the way to a web-hosted interactive dashboard? This week on the show, David Amos is back, and he's brought another batch of PyCoder's Weekly articles and projects.

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Plot With Pandas: Python Data Visualization Basics

2021-02-02T14:00:00+00:00

Whether you’re just getting to know a dataset or preparing to publish your findings, visualization is an essential tool. Python’s popular data analysis library, pandas, provides several different options for visualizing your data with .plot(). Even if you’re at the beginning of your pandas journey, you’ll soon be creating basic plots that will yield valuable insights into your data.

In this course, you’ll learn:

What the different types of pandas plots are and when to use them
How to get an overview of your dataset with a histogram
How to discover correlation with a scatter plot
How to analyze different categories and their ratios

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

The Real Python Podcast – Episode #45: Processing Images in Python With Pillow

2021-01-29T12:00:00+00:00

Are you interested in processing images in Python? Do you need to load and modify images for your Flask or Django website or CMS? Then you most likely will be working with Pillow, the friendly fork of PIL, the Python imaging library. This week on the show, we have Mike Driscoll, who is writing a new book about image processing in Python.

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Evaluate Expressions Dynamically With Python eval()

2021-01-26T14:00:00+00:00

The built-in Python function eval() is used to evaluate Python expressions. You can pass a string containing Python, or a pre-compiled object into eval() and it will run the code and return the result.

Although Python’s eval() is an incredibly useful tool, the function has some important security implications that you should consider before using it. In this course, you’ll learn how eval() works and how to use it safely and effectively in your Python programs.

In this tutorial, you’ll learn:

How Python’s eval() works
How to use eval() to dynamically evaluate arbitrary string-based or compiled-code-based input
How eval() can make your code insecure and how to minimize the associated security risks

The code in this course was tested with Python 3.9.0, eval() has not changed much and older versions should be compatible.

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Real Python

The Real Python Podcast – Episode #54: Building a Neural Network and How to Write Tests in Python

Python Community Interview With Will McGugan

Understanding Python List Comprehensions

OrderedDict vs dict in Python: The Right Tool for the Job

Choosing Between OrderedDict and dict

Getting Started With Python’s OrderedDict

The Real Python Podcast – Episode #53: Improving the Learning Experience on Real Python

Python Community Interview With Dane Hillard

Records and Sets: Selecting the Ideal Data Structure

Build an Asteroids Game With Python and Pygame

Demo: Asteroids Game in Python

Project Overview

Prerequisites

Step 1: Pygame Setup

Python Project

The Real Python Podcast – Episode #52: Connecting to MongoDB and Updates on the Python Packaging Landscape

Python AI: How to Build a Neural Network & Make Predictions

Artificial Intelligence Overview

Machine Learning

Feature Engineering

Deep Learning

Python Booleans: Leveraging the Values of Truth

Python Community Interview With Ewa Jodlowska

The Real Python Podcast – Episode #51: Navigating Options for Deploying Your Python Application

Build a Contact Book With Python, PyQt, and SQLite

Demo: A Contact Book With Python

Project Overview

Prerequisites

Django View Authorization: Restricting Access

The Real Python Podcast: It's Been a Year!

PyCon Speakers Shared Their Expertise

The Real Python Podcast – Episode #50: Consuming APIs With Python and Building Microservices With gRPC

New Features: Article Bookmarks, Completion Status, and Search Improvements

Article Completion Status and Bookmarks

Navigating Namespaces and Scope in Python

Python and MongoDB: Connecting to NoSQL Databases

Using SQL vs NoSQL Databases

Managing NoSQL Databases With MongoDB

The Real Python Podcast – Episode #49: The Challenges of Developing Into a Python Professional

Dictionaries and Arrays: Selecting the Ideal Data Structure

The Real Python Podcast – Episode #48: Stochastic Gradient Descent and Deploying Your Python Scripts on the Web

Creating PyQt Layouts for GUI Applications

The Real Python Podcast – Episode #47: Unraveling Python's Syntax to Its Core With Brett Cannon

Python Modulo: Using the % Operator

The Real Python Podcast – Episode #46: C for Python Developers and Data Visualization With Dash

Plot With Pandas: Python Data Visualization Basics

The Real Python Podcast – Episode #45: Processing Images in Python With Pillow

Evaluate Expressions Dynamically With Python eval()

Choosing Between `OrderedDict` and `dict`

Getting Started With Python’s `OrderedDict`