Scene data is stored as objects in Parquet or Delta files. Scene metadata is kept in the metadata store. Metadata about the enriched data is stored in a metadata store in Azure Cosmos DB.Ī Data Factory pipeline performs scene detection. The generated data is kept in Apache Parquet files that are compatible with the synchronized data. Enriched data helps to provide data scientists with insights that they can use in algorithm development, for example. Examples of enhancements include telemetry, vehicle logger data, and other data, such as weather, map, or object data. The synchronization algorithm runs on Batch.Ī Data Factory pipeline runs to enrich the data. If data from the vehicle logger isn't synchronized across the various sensors, a Data Factory pipeline is triggered that syncs the data to create a valid dataset.
0 Comments
Leave a Reply. |