数据湖技术在汽车行业的应用
+
“
AWS
- VP Connected Vehicle, Digital Backend, Big Data, BMW Group
多帐户设置有助于使数据工作负载民主化
API
Docs
DATA.B MW.CLO UD
Data Provider
ETL
Stream
Data Explorer
SQ LLab
Am azon S3
+
AW S G lue D ata Catalog
AW S Lake Form ation
AW S D atabase M igrationService | AW S Snow Fam ily | Am azon KinesisD ata Firehose | Am azon Kinesis D ata Stream s |Am azon M anaged Stream ing forKafka
Am azon Personalize Am azon Rekognition Am azon Forecast
Am azon Athena
Am azon EM R
AW S G lue
+
Am azon Redshift
Am azon Kinesis Data Analytics
Am azon Elasticsearch Service
数据湖技术在汽车行业的应用
技术创新,变革未来
• • • •
-
HPC
GPU
AV
AWS
ML
ML
Am azon Q uicksight Am azon SageM aker Am azon Com prehend Am azon Forecast
Am azon Lex
+
Am azon Poly
Amazon Neptune AWS Glue
8
5
9
Amazon SageMakerGround
Truth
10
AWS AppSync
“ Amazon EC2 P3 75%
Adrien Gaidon, PhD, Machine Learning Lead Toyota Research Institute
1
AWS Outposts
2
2
AWS IoT Core Amazon
Kinesis Data Firehose
4
10
6 3
3
Apache Airflow
4
ETL
GPS 5
6
ASAM OpenSCENARIO Amazon
DynamoDB Amazon Elasticsearch
Service
1
8
9
7
EMR
Enriched S3 bucket
Athena
CloudWatch
SageMaker
KMS
2
3 4 1 5 6 7
8
20-100TB
10-125
GPU200 – 60源自 PB 100 – 1000 10000 – 100000 GPU
100000 CPU/GPU 10000 CPU
7
•
•
•
•
•
•
•
•
•
•
•
•
[Session ID] AWS [Session ID] Momenta [Session ID] Megatronix
AWS AWS
Thank you!
Real time Streaming data from Connected vehicles
Ingest
Kinesis
Lambda
Decode
Firehose
Raw S3 bucket
Decoded S3 bucket
Transform
Analyze / Consume
Dynamo
API GW
Customers
AILab
Unbounded Data
Bounded Data
Data Consum er
Analytics Modeling
数据的提供商
流数据的大规模摄取
Data Provider
Mask PI
Pul
Legacy telem etry
O n-prem ise
Private V P C
Fargate
Kinesis Firehose
SQS
Push
Cloud-native telem etry
Prep
Local GlueD C
Cloud Data Hub
Source S3
SNS Prep S3
GlueD C Sync
Gl o b a l GlueD C
InfoSec
KMS CMK
Toyota
Region