Mistral AI: Unchallenged in quantized forms

 Llama 2 was talk of the town for a good time, when Open AI launched GPT there are worries that it’s planning to monopolise its capabilities. Its actions in the senate hearing, added fuel. Meta’s decision to giveaway Llama 2 gave a breather. It performed fairly well across all the parameters

Now, comes the new sensation Mistral AI, the one which changes the whole thought of being API based models to becoming one to one running on personal PCs. Of course, if we want to give the live knowledge going on around the world we still have to power with browsing capabilities.

Currently Mistral AI in quantized versions is of size 4GB and can easily on 16GB RAM. This is slightly higher than Llama 2 13B quantized version.

Vectorised Databases for specific uses, has become a trouble as being conducted on specific parameter. However, inter-operability of specific vectorised datasets is something to watch for over the period.

Euphoria of GenAI on Personal Computers is yet to be experienced, everyone is running in this race of making GenAI completely working on the personal consumer devices. 



Comments

Post a Comment

Popular posts from this blog

How is RBI regulating BNPL industry?

The Reserve Bank of India (RBI) has issued various guidelines and regulations for the operation of buy now pay later (BNPL) providers in India. Specific measures that the RBI has taken to regulate the BNPL industry include: Issuing guidelines on the operation of BNPL schemes: The RBI has issued guidelines on the operation of BNPL schemes, which outline the requirements that BNPL providers must follow in order to offer their services to consumers. These guidelines cover areas such as customer onboarding, credit risk assessment, and pricing of BNPL products. Requiring BNPL providers to obtain authorization: BNPL providers in India are required to obtain authorization from the RBI in order to operate. This process involves submitting an application to the RBI, which is then reviewed and approved or rejected based on the RBI's evaluation of the provider's financial stability, business model, and other factors. Supervising BNPL providers: The RBI monitors the activities of BNPL prov...
Read more

A deeper thought into Project Alpha and Tech

 There was sometime in 2019, I went on to Instagram and posted a video announcing Project Alpha. Which I did, to get committed to the public on creating it by 2022. Of course, I missed the deadlines. Let me get into what it is: I planned an ecosystem to target a large number entities which generally have a single model of transactions within their books. I planned that with BOTS and FLOWS. Now things really changed from what could potentially be a product, is now taken over with the GPT transformation over the past 3 years. It started in nuance stage in 2018 with it making strides with GPT-2. Now, with Chat GPT it aced itself to such a level, where a single person is able to create a better products. Encountering a new challenge On a fine day, someone asked me what's next? CA Exams through me out of my own world. I am no where near to experimentation. I started feeling struck and suffocated. Then I closed my eyes and took up a position in Big4. Here I am today, looking back into th...
Read more