Skip to content
  • Sponsors
  • Jobs
  • CV Checker
  • Employer check
  • Explore
  • Solicitors
SearchSearch companies and jobs
For solicitorsAsk InkyAI

When salary thresholds, the shortage list or sponsor rules change, and when we add something new. No spam.

Find

  • Sponsor search
  • Licence alerts
  • Check a job offer
  • Employer check
  • Jobs checked against the rules
  • Job alerts
  • Salary and points check
  • Who sponsors your job
  • Occupation codes and going rates
  • Visa timeline
  • Visa processing times
  • Revoked sponsors
  • Chrome extension
  • All tools

Learn

  • Guides
  • News
  • Community
  • Ask Inky
  • How Inky works
  • Videos
  • FAQ
  • How we write guides

For solicitors

  • List your firm
  • Firm sign in
  • Terms for firms
  • Find a solicitor

ImmigrationGPT

  • About
  • Give feedback
  • Contact
  • Advertise
  • Privacy
  • Terms
  • Community rules

ImmigrationGPT gives information about UK immigration, not advice on your own case. It is independent and not part of the Home Office. Under section 84 of the Immigration and Asylum Act 1999, only regulated advisers and lawyers can give immigration advice. For advice on your own case, find a regulated solicitor.

Contains public sector information licensed under the Open Government Licence v3.0 (opens in a new tab), including GOV.UK guidance and the Home Office register of licensed sponsors.

ImmigrationGPT includes data supplied by the Solicitors Regulation Authority (opens in a new tab). The SRA does not endorse ImmigrationGPT or any firm listed here.

Free to use. Adverts, Plus, answer packs, employer checks and CV reports pay for it.

© ImmigrationGPT

  • Home
  • Sponsors
  • Jobs
  • CV check
  • InkyAI, the ImmigrationGPT AI
Loading job details...
  1. Home/
  2. Jobs/
  3. DataBricks Engineer - Contract

DataBricks Engineer - Contract

Red Badger Consulting Limited, London

Our reading: some things to check

Apply on Red Badger Consulting Limited's site (opens in a new tab)Check this employer before you apply Check my CV against this job
Posted
4 months ago
Contract
Permanent
Listed on
Direct from the employer

Can this job be sponsored?

  • We could not tell the occupation from the title. Whether a job can be sponsored depends on its occupation code.

    Look up the occupation code (CASCOT) (opens in a new tab)
  • Red Badger Consulting Limited holds an A-rated Skilled Worker licence.

    Register of licensed sponsors, GOV.UK (opens in a new tab)

Read from the advert, the Home Office register and the Immigration Rules. Whether you can be sponsored also depends on your own circumstances, such as your age and visa history. This is information, not advice.

Email me jobs like this

New adverts for engineer in London.

Free, no account. One email to confirm, then only new adverts for this search that could be sponsored, one email a week at most, each with a link to stop. An address has one alert: a new one takes its place. See our privacy policy (opens in a new tab).

Check Red Badger Consulting Limited before you apply

Certificates of sponsorship by year where available, licence history, directors, Companies House records and accounts, and what is worth checking, in one report.

Check this employer
Advertisements

About the job

DataBricks Engineer   You must have - At least 2 years of commercial Databricks experience (current) - Strong AWS Skills - Be able to work 2 days a week onsite in Central London - Ideally have worked on a large scale DataBricks migration project previously - Strong understanding of Medallion Architecture - DataBricks certification would be welcome but we prefer hands on experience over theoretical   About Red Badger  We’re a tech and product consultancy, building enterprise software products for blue chip companies, multinationals and PLC’s. The best thing about Red Badger is; of course;  the team. We’ve been around for 15+ years now and we are over 120 strong. We are really proud of our people; we support and learn a lot from each other; we work really hard but have fun doing it. We are a diverse group made up of 22 different nationalities, speaking 17 different languages. Headquartered in London we also have offices in Leeds and Cape Town.    The Role
Show the full advertShow less of the advert
Red Badger is looking for a DataBricks Engineer to join our Data & AI practice. This is a delivery-focused role: you'll work directly with clients and Red Badger consultants, from all the cross functional disciplines, to shape complex technical solutions as an output from discovery phase, and then lead a team of data engineers to build the solution through to production. You'll work closely with the Director, Data & AI, and partner on pre-sales and proposals to add technical credibility and deepen our client partnerships. You love solving complex problems, and customer value is your north star. You are comfortable consulting with technology stakeholders outside of your team. You are a technology polyglot, and an evangelist for agile ways of working. Day to day, you will spend roughly half of your time hands on, pairing with data engineers on the team, and helping them pick the right design to solve the problem. In the other half, you’ll be supporting the other functions (delivery, product, software engineering) and our clients with decisions impacted by the technical strategy of the project and providing support and line management to data engineers on your team.   Key Responsibilities   Discipline Expertise and Leadership  - Technology breadth: Deep, production-grade experience across AWS &/or Azure native services, with expert-level Databricks and/or Snowflake and an Agile delivery mindset. - Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse,  - Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt - Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog / DataZone - AI: Bedrock (including AgentCore) and SageMaker AI - Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse - Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt - Data management & metadata:  Purview - AI: Foundry, (including Agent Service), ML - On AWS, you're fluent across the core services, for example:  - On Azure, you’re fluent across the core services, for example: - Data Product mentality: You build Data Products where every pipeline and dataset is discoverable, addressable and secure by design. - Data capabilities: You know the full data lifecycle, from discovery, storage, pipelines, ETL and streaming to data quality, governance, metadata management and cataloguing, through to advanced analytics and decision-making. - AI: You understand how AI is built and deployed in modern data platforms (Databricks, Snowflake) and cloud-native services like Amazon Bedrock, with enough depth to guide teams and advise clients, spanning LLMs and SLMs, agentic automation, Human in the Loop and MLOps. - Data Architecture Design: You know when to use RAG (Retrieval-Augmented Generation), Serverless, DWH models, Data Mesh, Data Fabric, Medallion and Data Products. - Hands on mindset: Fluent in the language of data, whether SQL, Python, PySpark, R or Scala.  Open formats including Parquet, Iceberg and JSON.   Agile Ways of Working - Run and contribute to agile ceremonies, helping to shape and improve the agile process - Work with the project’s delivery manager and product owner to lead the team in delivering high quality digital products - Lead and support your peers in technical conversations - Be an advocate for lean development, building for what is required now - Pairing with other members of the team, including designers   Consulting with Clients - Own the relationship with the client’s technical stakeholders - Proactively engage with clients to shape and move the project forward, including giving updates on the delivery progress and highlighting potential technical blockers - Upskilling and embedding modern data practices in client teams where necessary   Leadership & Influence   - Data Leadership: A proven track record of managing and inspiring teams, navigating enterprise-scale problems and turning them into opportunities for clients. - People-first leadership: You guide, mentor and grow your team, bring the Red Badger culture with you, and build effective, high-trust teams where everyone is heard and valued. - Stakeholder Artistry: You are a master of client-facing delivery. You can translate complex data concepts into business value, managing multi-vendor environments with a focus on long-term partnership. Lanyards off, you embed as one team rather than an outside supplier. - Designing for People and Purpose: Your expertise goes beyond just building scalable architectures; you design systems with a focus on delivering value. You ensure that your extensible and scalable solutions are implemented because they consistently meet the evolving needs of both the business and its users.   Your experience    - It’d be great if you   - Quality Advocate: You take pride in the integrity of your work, championing quality assurance and performance tuning so the data solutions we build are robust, reliable and respected. - Industry Stewardship: A lifelong learner who keeps a pulse on industry standards and best practice. - Partnership Focus: You build strong relationships with technology partners, established or new, to deliver the best outcomes for clients. - You care deeply about high-quality work that delivers real value - You're comfortable with ambiguity and solving complex problems collaboratively - You bring strong expertise in your craft, alongside a willingness to keep learning - You communicate clearly and build trust fast with clients, data engineering leaders and data and software engineers - You're pragmatic, adaptable, outcome-focused and low-ego in multidisciplinary teams - You lead with a people-first attitude, helping others grow and making sure people are heard, valued and set up to thrive   - It’d be amazing if you can also  - Negotiate SLAs and SLOs with the business and supporting teams - Help shaping and resourcing technical teams - Articulate commercial objectives into a technical strategy - Show a track record of owning the tech leadership on complex data projects, setting the technical vision for the project and managing technical stakeholders - Coach and line manage data engineers and data delivery individuals who are starting their line management journey - Be a part of the public face of the company in media and at meetups, conferences, etc.
Apply on Red Badger Consulting Limited's site (opens in a new tab)Check Red Badger Consulting Limited before you apply

Where can I look next?

  • More jobs at Red Badger Consulting Limited
  • Visa experiences with Red Badger Consulting Limited
Advertisements

What are the visa rules for a sponsored job?

Most new Skilled Worker jobs must pay at least £41,700 a year, or the going rate if that is higher. People new to the Skilled Worker route need B2 English, unless exempt.

  • What changed in 2026
  • B2 English from January 2026
  • What the visa costs

Check employers while you browse job sites with our free Chrome extension.

Back to job search

Adverts come from job boards and employers' own job sites. Only the employer can say whether it will sponsor this job.

Advertisements
Home Office figures show it sponsored workers in 3 of the 5 years from 2021 to 2025.