BITBW, the central IT service provider for the entire Baden-Württemberg state administration, is hiring a KI Data Scientist (w/m/d) for its KI Hub staff unit. You will build the data architecture for generative AI and AI agents in the state administration, with EG 14 TV-L pay, 30 vacation days, flexible hours and workation. The application deadline is 13 December 2026.
About BITBW
Role: Central IT service provider for the whole state administration of Baden-Württemberg
Mission: Make sure the administration works with modern IT equipment
Team: Staff unit KI Hub
Reference: 16231-KI Hub
Benefits & Career Opportunity
Pay: EG 14 TV-L, plus a company pension supplement
Time Off: 30 vacation days and extra days off on 24 and 31 December
Work Model: Generous flextime, individual part-time, mobile working and workation
Extras: JobTicket BW subsidy, JobBike BW leasing, fitness and wellness partners and a mentor programme
Position Overview
As KI Data Scientist, you design and take responsibility for the data architecture for generative AI and AI agents in the state administration, from data intake and preparation to delivery for models and applications. You design and run data platforms (data lake and lakehouse) with data modelling, catalogue, metadata management and lineage, build pipelines and secure data quality, and develop and tune RAG solutions and prompts. You assess data and models with suitable metrics, support data protection impact assessments and EU AI Act data requirements, define governance for the safe running of language models and advise departments and managers on data and AI questions.
Why This Role Matters: Public-sector AI has to be secure, lawful and sovereign. This role puts you at the centre of that work for a whole federal state, with flexible hours, workation and job security.
Key Responsibilities
Data Architecture & Platforms
- Design and take responsibility for the data architecture for generative AI and AI agents, from data intake to delivery for models and applications
- Design and run data platforms (data lake and lakehouse), including data modelling, catalogue, metadata management and lineage
- Build pipelines for intake and preparation of data sources and secure data quality
AI & Evaluation
- Develop and tune RAG solutions and prompts, including update concepts for databases
- Analyse and structure datasets and assess data and models with suitable metrics and evaluation methods
Governance & Advice
- Support data protection impact assessments and EU AI Act data and governance requirements, working with data protection and information security
- Define governance and control mechanisms for safe operation of language models and assess architecture options, including Deutschland-Stack conformity and digital sovereignty
- Advise departments and managers and contribute to state-wide and national expert committees
Qualifications
Education
- University degree or accredited master’s degree (qualification for the higher service), for example in computer science or another suitable course focused on AI engineering or data science
Experience & Skills
- Practical experience in data processing and analysis with Python and SQL and in building data pipelines
- Knowledge of modern LLM, RAG and agent architectures and the toolchain for inference, vector databases, orchestration and observability
- Experience designing architectures in regulated environments, treating data protection, IT security and compliance as design parameters
- Understanding of digital sovereignty in architecture decisions
Communication & Conditions
- Able to explain complex architecture precisely and clearly to leadership
- Non-EU applicants need a valid German work permit and sufficient German language skills
About BITBW
BITBW is the central IT service provider for the whole state administration of Baden-Württemberg. It makes sure the administration can work with modern IT equipment, and offers secure, future-oriented and meaningful work in the public sector.
How to Apply: Apply by 13 December 2026, quoting reference 16231-KI Hub, and state your desired part-time scope if you want one. The posting gives no email address, phone number, contact name or euro salary figure, so use the original listing to apply.
Who Should Apply?
- Data Scientists: With Python and SQL
- AI Engineers: Working with LLMs and RAG
- Data Architects: Using lakehouse platforms
- Governance Specialists: In EU AI Act and data protection
- Stuttgart Talent: Seeking public sector security
Recently Opening Job👇



