Hugging Face's logo
dfdf's picture
1 2 8

dfdf

novincom

AI & ML interests

None yet

Recent Activity

liked a Space about 2 months ago
Roboflow/RF-DETR
upvoted a paper 3 months ago
Finding 3D Positions of Distant Objects from Noisy Camera Movement and Semantic Segmentation Sequences
reacted to yeonseok-zeticai's post with šŸš€ 3 months ago
āš” RexBERT Complete On-device Study: Comprehensive Performance Analysis Across Mobile Devices (Check details at https://mlange.zetic.ai/p/Steve/RexBERT) TL;DR: Transformer models are now practical for real-time mobile applications. The cloud-to-edge AI migration is complete. - Original model from @thebajajra šŸŽÆ Study Overview: - Model: RexBERT (ModernBERT for E-commerce) - Focus: Real-world deployment viability and performance analysis šŸ“Š Key Performance Metrics: Latency Results: - NPU (Best): 4.74ms average - GPU: 12.56ms average - CPU: 35.16ms average NPU Advantage: 16.98x speedup over CPU Memory Efficiency: - Model Size: 568.96 MB (compressed for mobile) - Runtime Memory: 299.01 MB peak consumption - Load Memory Range: 285 MB - 1,072 MB across devices Accuracy Preservation: - FP16 Precision: 63.72 dB - Quantized Mode: Available with minimal accuracy loss - Inference Quality: Production-grade maintained šŸ›  Technical Implementation: (Runnable with Copy & Paste at the ZETIC.MLange link: https://mlange.zetic.ai/p/Steve/RexBERT) This study demonstrates that: Transformer models are viable for real-time mobile applications NPU acceleration provides the breakthrough needed for practical deployment Mobile-first AI architecture is now technically feasible The performance gap between cloud and edge inference is rapidly closing šŸš€ Real-World Applications Enabled: E-commerce Intelligence: - Instant product search and discovery - Real-time semantic matching - Context-aware recommendations - Natural language query processing Conversational Commerce: - Voice-to-product search - Chatbot-style shopping assistance - Intent recognition and classification - Multi-turn conversation handling Privacy-First AI: - On-device processing (no data transmission) - GDPR/privacy regulation compliant - Reduced server infrastructure costs - Offline capability maintenance Are you ready to integrate BERT-level language understanding into your mobile applications?
View all activity

Organizations

None yet