Hy-MT2 Translation
Deploy Hy-MT2 translation models on AGX Orin and AGX Thor
Description
1. Hy-MT2-1.8B BF16 AGX Orin、AGX Thor 8 GiB Orin approximately 34.0 tokens/second 2. Hy-MT2-7B BF16 AGX Orin、AGX Thor 24 GiB Orin approximately 9.8 tokens/second 3. Hy-MT2-1.8B FP8 AGX Thor 16 GiB Thor approximately 105.7 tokens/second 4. The measured first word response time of Thor FP8 is approximately 22.1 milliseconds 5. Orin 1.8B performed approximately 97.9 milliseconds in the sampled translation test
Screenshots



Mobile Screenshots



App Information
Original App