/* ---- Google Analytics Code Below */
Showing posts with label GPT-4. Show all posts
Showing posts with label GPT-4. Show all posts

Tuesday, May 30, 2023

Researchers from UC Berkeley Introduce Gorilla LLM

 And more implementations. 

Researchers from UC Berkeley Introduce Gorilla: A Finetuned LLaMA-based Model that Surpasses GPT-4 on Writing API Calls

By Tanya Malhotra

A recent breakthrough in the field of Artificial Intelligence is the introduction of Large Language Models (LLMs). These models enable us to understand language more concisely and, thus, make the best use of Natural Language Processing (NLP) and Natural Language Understanding (NLU). These models are performing well on every other task, including text summarization, question answering, content generation, language translation, and so on. They understand complex textual prompts, even texts with reasoning and logic, and identify patterns and relationships between that data.

Though language models have shown incredible performance and have developed significantly in recent times by demonstrating their competence in a variety of tasks, it still remains difficult for them to use tools through API calls in an efficient manner. Even famous LLMs like GPT-4 struggle to generate precise input arguments and frequently recommend inappropriate API calls. To address this issue, Berkeley and Microsoft Research researchers have proposed Gorilla, a finetuned LLaMA-based model that beats GPT-4 in terms of producing API calls. Gorilla helps in choosing the appropriate API, improving LLMs’ capacity to work with external tools to carry out particular activities.   .... ' 


Wednesday, March 22, 2023

GitHub unveils Copilot X: The Future of AI-powered Software Development

Now here is a future that has some real value ... 

GitHub unveils Copilot X: The future of AI-powered software development

Michael Nuñez in Venturebeat

@MichaelFNunez, March 22, 2023

Join top executives in San Francisco on July 11-12, to hear how leaders are integrating and optimizing AI investments for success. Learn More

GitHub, the leading platform for software development collaboration, has announced today the next step in AI-driven software development with the introduction of Copilot X. As a pioneer in the use of generative AI for code completion, GitHub is now taking its partnership with OpenAI further by adopting the latest GPT-4 model and expanding Copilot’s capabilities.

Launched less than two years ago, GitHub Copilot has already made a significant impact on the world of software development. GitHub reported today that the AI-powered tool, built using OpenAI’s Codex model, currently writes 46% of the code on the platform and has helped developers code up to 55% faster. By auto-completing comments and code, Copilot serves as an AI pair programmer that keeps developers focused and productive.

GitHub Copilot X, the upgraded version being released today, represents a bold vision for the future of AI-powered software development. With an emphasis on accessibility, the upgraded Copilot will now be available throughout the entire development life cycle, going beyond mere code completion. By incorporating chat and voice features, developers can communicate with Copilot more naturally. Additionally, Copilot X will be integrated into pull requests, command lines and documentation, providing instant answers to questions about projects.

The transformative potential of AI in software development is on full display with GitHub Copilot X. By reducing boilerplate and manual tasks, developers can focus on more complex and innovative work. This new level of productivity will allow developers to concentrate on the bigger picture, fostering innovation and accelerating human progress.  ... ' 

Replacing Coders Already?

Inevitable.... 

Startups Are Already Using GPT-4 to Spend Less on Human Coders

GPT-4 "saves a lot of time and a lot of money, obviously, because we haven't had to hire additional resources."   By Chloe Xiang, March 20, 2023, 9:00am

1674655888922-screen-shot-2023-01-25-at-91114-am

SCREENSHOT FROM OPENAI WEBSITE 

Since GPT-4 was released last week, many users have noticed its advanced coding abilities. GPT-4, OpenAI’s latest version of the large language model that ChatGPT is built on, has been able to code games like Pong and make simple apps after being given prompts written in conversational English. Naturally, this has led to widespread fear from a number of computer science students and software developers who are afraid that their jobs will soon be rendered obsolete by AI. ....' 


Tuesday, March 21, 2023

Startups Using GPT-4

GPT-4is impressive so far ....

Startups Are Already Using GPT-4 to Spend Less on Human Coders

GPT-4 "saves a lot of time and a lot of money, obviously, because we haven't had to hire additional resources."

By Chloe Xiang  in Vice.com

March 20, 2023, 9:00am

Since GPT-4 was released last week, many users have noticed its advanced coding abilities. GPT-4, OpenAI’s latest version of the large language model that ChatGPT is built on, has been able to code games like Pong and make simple apps after being given prompts written in conversational English. Naturally, this has led to widespread fear from a number of computer science students and software developers who are afraid that their jobs will soon be rendered obsolete by AI.    ... '


Use cases of GPT-4

 Directions and examples.....

MIT Technology Review

ARTIFICIAL INTELLIGENCE

How AI experts are using GPT-4

Plus: Chinese tech giant Baidu just released its answer to ChatGPT.

By Melissa Heikkiläarchive page

March 21, 2023   STEPHANIE ARNETT/MITTR | GETTY

This story originally appeared in The Algorithm, our weekly newsletter on AI. To get stories like this in your inbox first, sign up here.

WOW, last week was intense. Several leading AI companies had major product releases. Google said it was giving developers access to its AI language models, and AI startup Anthropic unveiled its AI assistant Claude. But one announcement outshined them all: OpenAI’s new multimodal large language model, GPT-4. My colleague William Douglas Heaven got an exclusive preview. Read about his initial impressions.  

Unlike OpenAI’s viral hit ChatGPT, which is freely accessible to the general public, GPT-4 is currently accessible only to developers. It’s still early days for the tech, and it’ll take a while for it to feed through into new products and services. Still, people are already testing its capabilities out in the open. Here are my top picks of the fun ways they’re doing that.

Hustling

In an example that went viral on Twitter, Jackson Greathouse Fall, a brand designer, asked GPT-4 to make as much money as possible with an initial budget of $100. Fall said he acted as a “human liaison” and bought anything the computer program told him to. 

GPT-4 suggested he set up an affiliate marketing site to make money by promoting links to other products (in this instance, eco-friendly ones). Fall then asked GPT-4 to come up with prompts that would allow him to create a logo using OpenAI image-generating AI system DALL-E 2. Fall also asked GPT-4 to generate content and allocate money for social media advertising. 

The stunt attracted lots of attention from people on social media wanting to invest in his GPT-4-inspired marketing business, and Fall ended up with $1,378.84 cash on hand. This is obviously a publicity stunt, but it’s also a cool example of how the AI system can be used to help people come up with ideas. 

Productivity

Big tech companies really want you to use AI at work. This is probably the way most people will experience and play around with the new technology. Microsoft wants you to use GPT-4 in its Office suite to summarize documents and help with PowerPoint presentations—just as we predicted in January, which already seems like eons ago. 

Not so coincidentally, Google announced it will embed similar AI tech in its office products, including Google Docs and Gmail. That will help people draft emails, proofread texts, and generate images for presentations.  

Health care

I spoke with Nikhil Buduma and Mike Ng, the cofounders of Ambience Health, which is funded by OpenAI. The startup uses GPT-4 to generate medical documentation based on provider-patient conversations. Their pitch is that it will alleviate doctors’ workloads by removing tedious bits of the job, such as data entry. 

Buduma says GPT-4 is much better at following instructions than its predecessors. But it’s still unclear how well it will fare in a domain like health care, where accuracy really matters. OpenAI says it has improved some of the flaws that AI language models are known to have, but GPT-4 is still not completely free of them. It makes stuff up and presents falsehoods confidently as facts. It’s still biased. That’s why the only way to deploy these models safely is to make sure human experts are steering them and correcting their mistakes, says Ng.

Writing code

Arvind Narayanan, a computer science professor at Princeton University, saysit took him less than 10 minutes to get GPT-4 to generate code that converts URLs to citations. 

Narayanan says he’s been testing AI tools for text generation, image generation, and code generation, and that he finds code generation to be the most useful application. “I think the benefit of LLM [large language model] code generation is both time saved and psychological,” he tweeted. 

In a demo, OpenAI cofounder Greg Brockman used GPT-4 to create a website based on a very simple image of a design he drew on a napkin. As Narayanan points out, this is exactly where the power of these AI systems lies: automating mundane, low-stakes, yet time-consuming task... ' 

Sunday, March 19, 2023

OpenAI Launches GPT-4 (Announcement, Description and Further Details)

 (Link throughs will be updated) 

OpenAI launches GPT-4!

MLOps Newsletter <mlops@substack.com> Unsubscribe

2:02 PM (2 hours ago)  to me

Open in app or online

You’re on the free list for MLOps Newsletter. For the full experience, become a paying subscriber.

Upgrade to paid

OpenAI launches GPT-4!

OpenAI introduces Whisper and ChatGPT APIs for commercial use cases

BUGRA AKYILDIZ    MAR 19

OpenAI released GPT-4 and it is a very significant improvement over GPT-3 or ChatGPT.

It is significantly better than ChatGPT(GPT3.5) in a variety of tasks through GPT-4 research.

Its main capabilities are:

Academic success as you see above graph, through visual inputs, it can solve a variety of exams.

Steerability: through socratic method, you can guide/influence and teach the model in a direction and correct some of its answers afterwards.

Visual Inputs: it accepts and can process the visual inputs.

You can learn more about doing the following things about GPT-4:

Read paper, View system card

Try on ChatGPT Plus

Join API waitlist

Rewatch demo livestream

Contribute to OpenAI Evals

My experience going through some examples:

answers become much more concise(comparing to verbosity in ChatGPT)

it can actually construct the sentences clearer and it can produce better/more readable long paragraphs comparing to ChatGPT.

Its code debugging capability is much better than ChatGPT.

The runs might take longer than ChatGPT. This might improve in future, though.

OpenAI also introduced ChatGPT and Whisper APIs officially. Engineers can now integrate ChatGPT and Whisper models into their apps and products through our API.

Google published a post on Vid2Seq, their new framework for captioning videos. The Vid2Seq architecture augments a language model with special time tokens, allowing it to seamlessly predict event boundaries and textual descriptions in the same output sequence. In order to pre-train this unified model, we leverage unlabeled narrated videos by reformulating sentence boundaries of transcribed speech as pseudo-event boundaries, and using the transcribed speech sentences as pseudo-event captions. The Vid2Seq architecture includes a visual encoder and a text encoder, which encode the video frames and the transcribed speech input, respectively. The resulting encodings are then forwarded to a text decoder, which autoregressively predicts the output sequence of dense event captions together with their temporal localization in the video. The architecture is initialized with a powerful visual backbone and a strong language model.

Yi Tay wrote about release of a new Flan 20B parameter model with UL2. In “Scaling Instruction-Finetuned language models (Chung et al.)” (also referred to sometimes as the Flan2 paper), the key idea is to train a large language model on a collection of datasets. These datasets are phrased as instructions which enable generalization across diverse tasks. Flan has been primarily trained on academic tasks. In Flan2, we released a series of T5 models ranging from 200M to 11B parameters that have been instruction tuned with Flan. UL2 is a unified framework for pretraining models that are universally effective across datasets and setups.

Thursday, March 16, 2023

GPT-4 Technical Report

Attended the GPT-4 introduction yesterday. Impressive demo and overview of new capabilities. Tech report abstract below nd link below. Some indication of power,  speed, directions and risks.  Somewhat weak in spefific how to examples. Notable is the indication of image support. 

https://cdn.openai.com/papers/gpt-4.pdf,      Total paper is 98 pages

GPT-4 Technical Report

OpenAI∗  Abstract

We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer based model pre-trained to predict the next token in a document. The post-training alignment process results in improved performance on measures of factuality and adherence to desired behavior. A core component of this project was developing infrastructure and optimization methods that behave predictably across a wide range of scales. This allowed us to accurately predict some aspects of GPT-4’s performance based on models trained with no more than 1/1,000th the compute of GPT-4.  ...

Introduction: ....


Notable Overviews:  

     GPT 4,  9 Insights

Tuesday, March 14, 2023

Greg Brockman of OpenAI Talks today on GPT-4 at 4 PM ET

 https://www.youtube.com/watch?v=outcGtbnMuQ 

26,739 waiting  Scheduled for Mar 14, 2023

Join Greg Brockman, President and Co-Founder of OpenAI, at 1 pm PT for a developer demo showcasing GPT-4 and some of its capabilities/limitations.

Join the conversation on Discord here: discord.gg/openai   ... 

> Will be attending and reporting back to clients selectively.    - Franz