UAE’s Technology Innovation Institute Revolutionizes AI Language Models With New Architecture

ABU DHABI, United Arab Emirates--(BUSINESS WIRE)--Aug 12, 2024--

The Technology Innovation Institute (TII), a leading global scientific research center and the applied research pillar of Abu Dhabi’s Advanced Technology Research Council (ATRC), has released a new large language model in its Falcon series, the Falcon Mamba 7B. The new model is the no. 1 globally performing open source State Space Language Model (SSLM) in the world, as independently verified by Hugging Face.

This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20240812019509/en/

As the first SSLM for Falcon, it departs from prior Falcon models which all use a transformer-based architecture. This new Falcon Mamba 7B model is yet another example of the pioneering research the institute is conducting and the breakthrough tools and products it makes available to the community in an open source format.

H.E. Faisal Al Bannai, Secretary General of ATRC and Adviser to the UAE President for Strategic Research and Advanced Technology Affairs, said: “The Falcon Mamba 7B marks TII’s fourth consecutive top-ranked AI model, reinforcing Abu Dhabi as a global hub for AI research and development. This achievement highlights the UAE’s unwavering commitment to innovation.”

For transformer architecture models, Falcon Mamba 7B outperforms Meta’s Llama 3.1 8B, Llama 3 8B, and Mistral’s 7B on the newly introduced benchmarks from HuggingFace. Meanwhile for the other SSLMs, Falcon Mamba 7B beats all other open source models in the old benchmarks and it will be the be first model on HuggingFace’s new tougher benchmark leaderboard.

Dr. Najwa Aaraj, Chief Executive of TII, said: “The Technology Innovation Institute continues to push the boundaries of technology with its Falcon series of AI models. The Falcon Mamba 7B represents true pioneering work and paves the way for future AI innovations that will enhance human capabilities and improve lives.”

State Space models are extremely performant at understanding complex situations that evolve over time, such as a whole book. This is because SSLMs do not require additional memory to digest such large bits of information.

Transformer based models, on the other hand, are very efficient at remembering and using information they have processed earlier in a sequence. This makes them very good at tasks like content generation, however, because they compare every word with every other word, this requires significant computational power.

SSLMs can find applications in various fields such as estimation, forecasting, and control tasks. Similar to the transformer architecture models, they also excel in Natural Language Processing tasks and can be applied to machine translation, text summarization, computer vision, and audio processing.

Dr. Hakim Hacid, Acting Chief Researcher of the TII’s AI Cross-Center Unit, said: “As we introduce the Falcon Mamba 7B, I’m proud of the collaborative ecosystem of TII that nurtured its development. This release represents a significant stride forward, inspiring fresh perspectives and further fueling the quest for intelligent systems. At TII, we’re pushing the boundaries of both SSLM and transformer models to spark further innovation in generative AI.”

Falcon LLMs have been downloaded over 45 million times, proving the outstanding success of the models. Falcon Mamba 7B will be released under TII Falcon License 2.0, the permissive Apache 2.0-based software license which includes an acceptable use policy that promotes the responsible use of AI. More information on the new model can be found at FalconLLM.TII.ae.

*Source:AETOSWire

Technology Innovation Institute (TII): Performance benchmarks - (Infographic: AETOSWire)

UAE’s Technology Innovation Institute Revolutionizes AI Language Models With New Architecture (Photo: AETOSWire)

HOUSTON (AP) — When Baylor and LSU face off in the Texas Bowl on Tuesday, it will be the first meeting between the teams since the 1985 Liberty Bowl.

But they do have some familiarity with one another. Baylor coach Dave Aranda spent 2016-19 on the LSU staff, helping the Tigers to the 2019 national championship as defensive coordinator before leaving for Waco.

“It’s really cool,” Aranda said. “So many good memories and such great people, and such respect and appreciation for all of it. How my family was treated, just all of it.”

And he still holds an affinity for the school.

“I’m rooting for LSU — except for this game,” Aranda said.

Aranda’s Bears (8-4) enter the game on a high note with a six-game winning streak that came after they won just two of their first six games this season.

“I think there’s some momentum going,” Aranda said. “You get that momentum by winning, and that’s what we’ve been able to do. And we’ve got to be able to continue to do that, in any circumstance. I think if we do that, it puts us in a good position for next year, to be able to win some more.”

LSU (8-4) has won two in a row after a three-game skid as the Tigers head into their third bowl appearance under coach Brian Kelly.

“The game is such an interesting one in that momentum, belief, confidence, they all play a role,” Kelly said. “When teams are fairly equal — and that’s what the case is — all those things that I just mentioned play a role. You’re playing a team that believes they’re going to win. They’ve won games that they hadn’t won in a long time. They’ve gotten all that out of the way. So, that’s probably the biggest challenge.”

These teams both feature veteran quarterbacks in LSU’s Garrett Nussmeier and Baylor’s Sawyer Robertson.

Nussmeier ranks second in the Southeastern Conference and sixth in the nation with 3,739 yards passing and his 26 TD passes are second in the SEC. In 13 career starts, he has thrown at least two touchdown passes nine times and thrown for more than 300 yards eight times, including seven this season.

He’s led the Tigers to a 9-4 record as a starter.

Robertson leads the Big 12 with an 83.9 quarterback rating that ranks sixth in the nation. He started his career with the late coach Mike Leach at Mississippi State before transferring to Baylor last season.

He has thrown for a career-high 2,626 yards with 26 touchdowns and seven interceptions this season.

LSU will be without several top players Tuesday after tight end Mason Taylor, receiver Kyren Lacy and tackles Will Campbell and Emery Jones opted out as they prepare for the NFL draft.

Taylor, the son of NFL Hall of Fame Jason Taylor, had 55 receptions for a career-high 546 yards and two touchdowns as a junior before declaring for the draft earlier this month.

Lacy led the Tigers with 866 yards receiving and nine touchdowns and ends his career with 2,360 yards receiving.

Baylor receiver Josh Cameron leads the team with nine touchdown receptions this season, which ranks 11th in school history. His 44 receptions for 643 yards also lead the team and are both career highs.

The performance comes after he didn’t score a touchdown in his first two seasons.

Cameron is also the team’s punt returner, and he ranks second in the country by averaging 20.7 yards per return.

Get poll alerts and updates on the AP Top 25 throughout the season. Sign up here. AP college football: https://apnews.com/hub/ap-top-25-college-football-poll and https://apnews.com/hub/college-football

FILE - LSU quarterback Garrett Nussmeier (13) passes in the first half of an NCAA college football game against Vanderbilt in Baton Rouge, La., Saturday, Nov. 23, 2024. (AP Photo/Gerald Herbert, File)

FILE - Baylor head coach Dave Aranda watches his team warm up before an NCAA college football game against Iowa State, Saturday, Oct. 5, 2024, in Ames, Iowa. (AP Photo/Charlie Neibergall, File)