Gemini 1.5 Pro: 1M Context Window Experience

Question

What’s your experience with Gemini 1.5 Pro’s 1M token context window – I’m currently processing 80-page legal documents and seeing a 3x increase in coherence compared to PaLM 2, but the latency is a concern at 15 seconds per query.

Emma Chen · Accepted Answer

Wow, 15 seconds is definitely a bottleneck – I’m seeing similar latency with Midjourney when processing a 30-page case study, though the coherence jump with Gemini 1.5 Pro is incredible; let’s explore ways to optimize prompts for faster results.

Gemini 1.5 Pro: 1M Context Window Experience

1 Replies

Related discussions

Related reading on AIZyla