[{"name":"R5-250156","title":"Overview Update on AIML Progress in 3GPP RAN Core Groups","source":"CMCC, Lenovo","contact":"Dan Song","contact-id":86282,"tdoctype":"discussion","for":"Endorsement","abstract":"Observations:_x000D_\nObservation 1: AI has shown some performance gains in multiple use cases, but it still faces many challenges in terms of model training data acquisition, data privacy security, model generalization, additional computing power and system complexity required for model training and inference._x000D_\nObservation 2: No significant progress has been observed in RAN1\/RAN2\/RAN4 groups for AIML in Q4 2024._x000D_\nProposals:_x000D_\nProposal 1: RAN5 continues to look for opportunity to start contributing to topics that could speed up the work of Rel-19 AIML core WI._x000D_\nProposal 2: Besides the areas below, RAN5 continues to identify more areas where RAN5 expertise may help to progress core group work._x000D_\nAIML conformance test framework._x000D_\nMU\/TT analysis based on RAN4 test parameters and test setup._x000D_\nUE lab conformance aspects of post-deployment testing.","secretary_remarks":"","agenda_item_sort_order":12,"ainumber":"4.2.3","ainame":"AI\/ML Testability & Interoperability","tdoc_agenda_sort_order":1560,"status":"revised","reservation_date":"2025-01-24 08:05:15","uploaded":"2025-02-08 08:49:44","revisionof":"","revisedto":"R5-251237","release":"","crspec":"","crspecversion":"","workitem":"","crnumber":"","crrevision":"","crcategory":"","tsg_crp":"","lsreplyto":"","lsto":"","Cc":"","lsoriginalls":"","lsreply":"","link":"https:\/\/www.3gpp.org\/ftp\/tsg_ran\/WG5_Test_ex-T1\/TSGR5__106_Athens\/Docs\/R5-250156.zip","group":"R5","meeting":"R5-106","year":2025,"uicc_affected":"","me_affected":"","ran_affected":"","cn_affected":"","clauses_affected":"","crsinpack":null,"crsinpacknumber":0},
{"name":"R5-250157","title":"Discussion on AIML Post Deployment Testing","source":"CMCC, ZTE","contact":"Dan Song","contact-id":86282,"tdoctype":"discussion","for":"Endorsement","abstract":"Potential Solutions for Post-deployment Testing _x000D_\nSolution 1: For the Post-deployment testing of the updated AI\/ML model, to use the performance of the verified\/certified model (\u201cModel_1\u201d) in the Post-deployment testing as the \u201cminimum requirements\u201d. If the performance of the updated model (\u201cModel_2\u201d) is not worse than\/similar to the performance of the verified\/certified model (\u201cModel_1\u201d) in the Post-deployment testing, the updated model (\u201cModel_2\u201d) can be regarded as \u201cPASS\u201d or \u201capplicable models\u201d which is ready to be activated._x000D_\nSolution 2: For the Post-deployment testing of the updated AI\/ML model (\u201cModel_2\u201d), to use the same model input\/ground truth as the ones used in Pre-Deployment Testing. Basing on the same model input\/ground truth, to compare the performance of the updated model (\u201cModel_2\u201d) in the Post-deployment testing with the performance of the verified\/certified model (\u201cModel_1\u201d) in the Post-deployment testing._x000D_\nProposal 1: RAN5 to evaluate the feasibility of the Solution 1~2 above and take them into consideration when discussing post-deployment testing._x000D_\nSolution 3: Besides to be used in Pre-deployment testing, test mode also can be used in Post-deployment Testing. _x000D_\nSolution 4: Besides to be used in UE lab conformance testing, test mode also can be considered in AI\/ML model Post-deployment Field Testing. Once AI\/ML UEs are in idle\/inactive modes, test mode can be triggered to test\/verify\/certify the AI\/ML models. When UE is in test mode, the AI\/ML model performance can be tested\/verified\/certified by UE\u2019s being connected to the testing server, and the users\u2019 common communication services might be impacted._x000D_\nProposal 2: RAN5 to evaluate the feasibility of the Solution 3~4 above and take them into consideration when discussing AIML conformance test framework.","secretary_remarks":"","agenda_item_sort_order":12,"ainumber":"4.2.3","ainame":"AI\/ML Testability & Interoperability","tdoc_agenda_sort_order":1570,"status":"revised","reservation_date":"2025-01-24 08:05:15","uploaded":"2025-02-08 08:49:44","revisionof":"","revisedto":"R5-251372","release":"","crspec":"","crspecversion":"","workitem":"","crnumber":"","crrevision":"","crcategory":"","tsg_crp":"","lsreplyto":"","lsto":"","Cc":"","lsoriginalls":"","lsreply":"","link":"https:\/\/www.3gpp.org\/ftp\/tsg_ran\/WG5_Test_ex-T1\/TSGR5__106_Athens\/Docs\/R5-250157.zip","group":"R5","meeting":"R5-106","year":2025,"uicc_affected":"","me_affected":"","ran_affected":"","cn_affected":"","clauses_affected":"","crsinpack":null,"crsinpacknumber":0},
{"name":"R5-251237","title":"Overview Update on AIML Progress in 3GPP RAN Core Groups","source":"CMCC, Lenovo","contact":"Ingbert Sigovich","contact-id":28887,"tdoctype":"discussion","for":"Endorsement","abstract":"","secretary_remarks":"","agenda_item_sort_order":12,"ainumber":"4.2.3","ainame":"AI\/ML Testability & Interoperability","tdoc_agenda_sort_order":1561,"status":"noted","reservation_date":"2025-03-03 20:00:05","uploaded":"2025-03-03 20:01:06","revisionof":"R5-250156","revisedto":"","release":"","crspec":"","crspecversion":"","workitem":"","crnumber":"","crrevision":"","crcategory":"","tsg_crp":"","lsreplyto":"","lsto":"","Cc":"","lsoriginalls":"","lsreply":"","link":"https:\/\/www.3gpp.org\/ftp\/tsg_ran\/WG5_Test_ex-T1\/TSGR5__106_Athens\/Docs\/R5-251237.zip","group":"R5","meeting":"R5-106","year":2025,"uicc_affected":"","me_affected":"","ran_affected":"","cn_affected":"","clauses_affected":"","crsinpack":null,"crsinpacknumber":0},
{"name":"R5-251372","title":"Discussion on AIML Post Deployment Testing","source":"CMCC, ZTE","contact":"Ingbert Sigovich","contact-id":28887,"tdoctype":"discussion","for":"Endorsement","abstract":"","secretary_remarks":"","agenda_item_sort_order":12,"ainumber":"4.2.3","ainame":"AI\/ML Testability & Interoperability","tdoc_agenda_sort_order":1571,"status":"noted","reservation_date":"2025-03-03 20:00:09","uploaded":"2025-03-03 20:01:06","revisionof":"R5-250157","revisedto":"","release":"","crspec":"","crspecversion":"","workitem":"","crnumber":"","crrevision":"","crcategory":"","tsg_crp":"","lsreplyto":"","lsto":"","Cc":"","lsoriginalls":"","lsreply":"","link":"https:\/\/www.3gpp.org\/ftp\/tsg_ran\/WG5_Test_ex-T1\/TSGR5__106_Athens\/Docs\/R5-251372.zip","group":"R5","meeting":"R5-106","year":2025,"uicc_affected":"","me_affected":"","ran_affected":"","cn_affected":"","clauses_affected":"","crsinpack":null,"crsinpacknumber":0}]