Senior Data Engineer

🌍 Hello World!

We are The Codest – International Tech Software Company with tech hubs in Poland delivering global IT solutions and projects. Our core values lie in “Customers and People First” approach that prioritises the needs of our customers and a collaborative environment for our employees, enabling us to deliver exceptional products and services.

Our expertise centers on web development, cloud engineering, DevOps and quality. After many years of developing our own product – Yieldbird, which was honored as a laureate of the prestigious Top25 Deloitte awards, we arrived at our mission: to help tech companies build impactful product and scale their IT teams through boosting IT delivery performance. Through our extensive experience with product development challenges, we have become experts in building digital products and scaling IT teams.

But our journey does not end here – we want to continue our growth. If you’re goal-driven and looking for new opportunities, join our team! What awaits you is an enriching and collaborative environment that fosters your growth at every step.

We are currently looking for a:

Senior Data Engineer

💡Project Description:

In this role, you will have the opportunity to specialize in leveraging artificial intelligence to optimize clinical and commercial workflows within the pharmaceutical, biotechnology, and life sciences industries. You’ll be at the forefront of utilizing AI-driven insights into trial design, indication selection, competitive intelligence, and market landscaping. Your focus in this project will be on simplifying complex data into actionable intelligence, ultimately enhancing efficiency and effectiveness across these vital sectors.

📈 Your Responsibilities:

• Design and build robust, scalable data pipelines to support AI models
• Ensure smooth data flow from various sources for analysis and deployment
• Utilize state-of-the-art techniques for processing diverse data types
• Oversee database management and optimization
• Focus on optimizing data storage, retrieval, and security
• Implement optimal data structuring techniques for vector retrieval and LLM behavior

🔑 Key Requirements:

• Extensive experience with Python programming language and with data engineering projects (around 7 years of commercial experience)
• Experience with data orchestration tools such as Airflow and Prefect
• Good familiarity with PostgreSQL
• Proficient in web scraping techniques
• Strong skills in data manipulation with Pandas library
• Understanding of parallelization techniques for efficient processing
• Knowledge of anti-botting measures for secure operations
• Proficiency in data orchestration tools for managing workflows effectively
• Strong skills in designing efficient database schemas
• Understanding of ensuring data integrity and reliability for robust systems
• Advanced English in speaking and writing (you will be working with international clients only)

➕ Nice to have:

• Experience with AI, LLM, and embeddings
• Familiarity with developing multimodal models
• Knowledge of database optimization techniques
• Full stack experience with NextJS/React
• Experience with Agile methodologies, particularly the Scrum framework

📜 Our Promise (what you can expect from us):

• 24-28k on a B2B contract
• 100% remote work (but we have offices in Krakow and Warsaw and we’re happy to meet there from time to time 😉)
• 1800 PLN per year for your self-development
• 1800 PLN per year for all of your home office needs
• Our B2B contract contains provisions that allow you to obtain IP BOX support
• Integration events, education opportunities and much more…
• A unique opportunity to take your career to the next level – we’re looking for people who want to create an impact. You have ideas, we want to hear them!

📌 Recruitment process:

• 30 minute screening call online with our recruiter
• 30-45 minute technical interview with our developer
• 1h client call
• Offer

Questions, insights? Feel free to reach out to our recruiting team:

ewa.szczodrak@thecodest.co

In the meantime, feel free to visit our website where you can find key facts about us.