Skip to content

Putting it all together

For the complete documentation index see: llms.txt

All documentation pages available in markdown.

Full pipeline architecture

Across three tutorials, you set up a complete ML pipeline:

StagePartClientPurpose
IngestPart 1Spark connectorBulk-write feature metadata and entity values
TrainPart 2Spark connector + MLlibMaterialize datasets, train and save models
ServePart 3Python clientRetrieve features in real time and run inference

The Spark connector and Python client are complementary. Batch pipelines need distributed throughput, and serving needs direct low-latency key lookups.

What you completed in Part 3

  • Used the Aerospike Python client for sub-millisecond feature retrieval
  • Used Entity.get_feature_vector() to drive low-latency feature retrieval in the serving path
  • Built predict_decline_risk() for end-to-end online inference
  • Verified that retrieval latency stays sub-millisecond at larger scale

If your project has feature_store_tutorial.ipynb, models/trip_decline_risk_lr, and datasets/trip-decline-risk-v1/, you have the core artifacts from the full tutorial series.

Production considerations

The tutorial pipeline demonstrates the core pattern. In production, you’d also consider:

ConcernApproach
Connection poolingReuse the Aerospike client connection across requests. The client is thread-safe.
Model versioningSave models with version suffixes (trip_decline_risk_lr_v2). Load the active version from a config or registry.
Feature freshnessBatch pipelines update features periodically. Monitor staleness because features that have not been updated may indicate a pipeline failure.
Graceful degradationIf get_feature_vector() returns None, fall back to a default prediction or distance-only ranking.
MonitoringTrack prediction latency, feature retrieval latency, and prediction distribution over time. A shift in distribution may indicate data drift.

Where to go next

Feedback

Was this page helpful?

What type of feedback are you giving?

What would you like us to know?

+Capture screenshot

Can we reach out to you?