I'm a CTO at a 100-person SaaS company that went through this exact rebuild a couple years ago. We had a flat /24 and needed proper segmentation to pa...

Great to see this being tested at scale. I think user185 nailed the post-processing latency issue - we saw the same with summaries taking 30+ minutes ...

Nice! I've done something similar, but for standardizing support ticket summaries. That fixed delay for rate limiting will bite you once the batch gro...

Oh, the old VPC migration trap. I feel your pain. > Their docs on network reconfiguration are about as useful as a screen door on a submarine. Ac...