Back to jobs

AI POC build required quick turn around

Search - AI Chatbot · ai_analyzed · UID ~022082462202624577045

Open Job

Job Details

Budget Unknown
ExperienceIntermediate
DurationUnknown
Weekly hoursUnknown
Client countryAbout the client
ProposalsLess than 5
Interviewing0
Invites sent0
First seenWed, Jul 29, 2026 4:50 PM
Last seenThu, Jul 30, 2026 1:23 AM

Description

Summary POC required for a demo on a quick turnaround basis: Requirements: 1- Single-Compose Stack: Deliver a docker-compose.yml deploying Ollama (Llama 3 + Nomic-embed), Qdrant, and MLflow on a single AWS GPU instance (g4dn.xlarge). 2- Single-File Streamlit UI: Build a bare-bones app.py featuring a basic PDF file uploader and a standard conversational chat interface. 3- Local RAG Engine: Implement fast character-based chunking for uploaded PDFs and upsert the vector embeddings directly into Qdrant via Ollama. 4- NeMo Guardrails Block: Route chat queries through NeMo Guardrails using its native OpenAI-compatible API to instantly intercept and refuse forbidden topics. 5- MLflow Telemetry: Instrument the query pipeline to automatically log all prompts, completions, execution latency, and token metrics into the MLflow dashboard. Ideal for someone who has delivered similar apps many times over.

Skills

Python MLflow AWS Application

Notification History

ChannelTypeStatusSentError
telegram pre_ai_job_alert sent Wed, Jul 29, 2026 4:51 PM -

User Actions

ActionActed at
No actions.