Data Platform Engineering/Data Engineering
| Group: | Data Platform Engineering |
| Team: | Aleksandar Mastilovic, Andrew Otto, Antoine Quhen, Antonio Pizzata, Javier Montón Larraz, Joseph Allemandou, Marcel Ruiz Forns, Sandra Nwoko, Thomas Chin, Xabriel Collazo Mojica, Dan Andreescu, Aisha Khatun |
| Backlog: | Data Engineering |
| Management: | Andreas Hoelzl (Engineering Manager) |
Responsibilities
[edit]The Data Enginering team is responsible for the core capabilities of the data platform, including data storage, batch and streaming infrastructure, and distributed query engines, providing data product services and supporting analytics workflows.
This platform supports ingestion of Wikimedia project content, web traffic, instrumentation, operational data and other datasets into the Data Lake. The team manages the ingress data pipelines, foundational data pipelines and analytics and metrics infrastructure.
The team's responsibilities also include data quality, observability, and discoverability.
The Event Platform has been merged into this team.
Planning & Goal setting
[edit]Data Engineering is generally supporting work as part of the Annual Plan.
Additionally the team is scoping platform and maintenance work, so called Essential Work.
The backlog and current quarterly work of the Data Engineering team is tracked in the Data Engineering Phabricator board.
New backlog items are triaged every week.
Technical Documentation
[edit]Have a look at Wikitech | Data Engineering
Contact Us
[edit]Please see the Intake Process page to make a request or contact one of our Product Managers.