Advanced LLM based on Mixture of Experts architecure to deliver compute efficient content generation