AWS added Intelligent Prompt Routing and Prompt Caching to Bedrock in hopes of getting model usage prices down.

AWS is designing more hardware in-house as it looks for opportunities to enhance data-center efficiency and reduce costs.

For example ... Ethan Simmons, managing partner of AWS partner PTP, agreed that AWS manufacturing its own AI processors will help customers both with cost and access to AI chips.