I think RAG will be there for more domain specific adaptation. It wll be to early to discard RAG as an technique , I forsee an ensemble in near future for these evolving models .