Cloud-Native Development for UK AI — UK GDPR Article 22 Built In

ML Model Serving on AWS

Production ML model serving: SageMaker real-time endpoints (managed inference, auto-scaling, A/B testing), SageMaker Serverless Inference (per-invocation billing for spiky workloads), and custom FastAPI inference server on ECS Fargate (for full control over dependencies). Model registry: SageMaker Model Registry for versioning, approval workflow, and deployment tracking. Monitoring: SageMaker Model Monitor for data drift, prediction quality drift, and bias drift detection.

LLM API Integration Architecture

Production LLM architecture: never call LLM APIs synchronously from user-facing API (latency is unpredictable — 1–30 seconds). Pattern: async LLM request queue (SQS), Lambda consumer calling Anthropic/OpenAI API, WebSocket or Server-Sent Events for streaming response back to client. Rate limiting: track tokens per minute per user (LLM APIs have rate limits — exponential backoff + jitter). Cost control: token budget per request, prompt caching where APIs support it.

UK GDPR Article 22 Cloud AI Architecture

Article 22 applies when AI makes automated decisions with significant legal or similarly significant effects. Cloud AI architecture for UK GDPR compliance: human review interface for high-impact decisions (reject a loan application, deny an insurance claim), explainability endpoint (why did the model make this decision?), decision audit log (immutable — Article 22 requires individuals to have the right to explanation), and opt-out mechanism (human review on request).

AI Cost Optimisation on AWS

Production LLM costs can scale unpredictably. Cost controls: prompt caching (Anthropic Prompt Caching reduces token cost for repeated context), response streaming (stops generation when user has enough — reduce unnecessary tokens), batch processing (AWS Bedrock Batch Inference — 50% lower cost for non-real-time workloads), model tier selection (use smallest model that satisfies quality threshold), and per-user token budgets (prevent runaway costs from single users).

UK GDPR Article 22

ICO AI guidance

Cyber Essentials

NHS DSP Toolkit (for HealthTech AI)