Gentrace helps the most impactful companies in the world like Quizlet systematically test and evaluate their AI applications. We recently raised an $8M Series A from Matrix Partners.
Ideal candidate profile:
- We use TypeScript and React heavily. We prefer candidates with strong experience with modern web technologies.
- 4+ years experience working in a full stack capacity.
Gentrace helps the most impactful companies in the world like Quizlet systematically test and evaluate their AI applications. We recently raised an $8M Series A from Matrix Partners.
Ideal candidate profile: - We use TypeScript and React heavily. Although not required, we prefer candidates with strong experience with modern web technologies. - 4+ years experience working in a full stack capacity.
Role info: https://gentrace.ai/eng Email: jobs@gentrace.ai
Gentrace helps the most impactful companies in the world like Quizlet systematically test and evaluate their AI applications. We recently raised an $8M Series A from Matrix Partners.
Ideal candidate profile:
- We use TypeScript and React heavily. Although not required, we prefer candidates with strong experience with modern web technologies.
- 4+ years experience working in a full stack capacity.
Gentrace | TypeScript + React | Hybrid (Williamsburg, Brooklyn & San Francisco)
Gentrace helps the most impactful companies in the world like Quizlet systematically test and evaluate their AI applications. We recently raised an $8M Series A from Matrix Partners.
Ideal candidate profile:
- We use TypeScript and React heavily. Although not required, we prefer candidates with strong experience with modern web technologies.
- 4+ years experience working in a full stack capacity.
Gentrace helps the most impactful companies in the world like Quizlet and Webflow systematically test and evaluate their AI applications. We recently raised an $8M Series A from Matrix Partners.
Ideal candidate profile:
- We use TypeScript and React heavily. Although not required, we prefer candidates with strong experience with modern web technologies.
- 4+ years experience working in a full stack capacity.
When building evaluation infrastructure for generative AI systems at Gentrace [1], we needed a task queue that could handle thousands of tasks per day while remaining simple to self-host.
We considered traditional options like RabbitMQ and Kafka but wanted to avoid the operational overhead for our self-hosted customers. That's when we turned to PostgreSQL.
Using PostgreSQL's FOR UPDATE SKIP LOCKED, we built a task queue that supports retries, parallelism, and large payloads, all without adding new infrastructure. Sometimes, PostgreSQL really is all you need!
It's been running in production at Gentrace, handling 8-10k tasks daily with peaks of 45k during large-scale evaluations. The architecture is simple, reliable, and easy to maintain.
We decided to open-source a version of this implementation as Simple Task Queue. It includes:
- A task queue built on PostgreSQL
- Type-safe task definitions and scheduling in TypeScript
- Support for retries, parallel processing, and scheduled tasks
Excited to give this a try! A visual environment seems like a natural fit for chained LLM calls.
Have you considered supporting OSS LLMs? Inference servers like LocalAI or vLLM expose APIs for various OSS models with OpenAI-compatible endpoints, so might not be much more work to integrate.
And yes, we'd love to support OSS LLMs. And we welcome contributions ;)
Rivet also has a plug-in system, and our friends at AssemblyAI were actually able to develop a plug-in for using their audio transcription and understanding AI models in Rivet!
That's an interesting use. We don't have that currently, since we haven't had anyone request workflows only using our evaluators as a service.
That said, we would like every part of our application to be controllable through API requests eventually, which would naturally support your use case.
Would you be open to diving deeper into your requirements? The best way to reach us is at support@gentrace.ai
Gentrace helps the most impactful companies in the world like Quizlet systematically test and evaluate their AI applications. We recently raised an $8M Series A from Matrix Partners.
Ideal candidate profile: - We use TypeScript and React heavily. We prefer candidates with strong experience with modern web technologies. - 4+ years experience working in a full stack capacity.
Role info: https://gentrace.ai/eng Email: jobs@gentrace.ai