Comparing Claude 3, Google Gemini and GPT4 is a difficult challenge as all three AI tools are constantly updated and can do such a wide variety of tasks.
For this comparison, let’s compare the writing output as I am not a developer so I can’t give an accurate comparison of the generated code. (Claude 3 is supposed to be the best!)
Let’s dig in.
Does Claude 3 Live Up to the Hype?
Claude 3 is the most recent of these three Models to be released and is actually split into three models: Haiku, Sonnet and Opus. Each model is better for different tasks with Haiku more efficient for lighter workloads and Opus the best for larger workloads. They also get more expensive to run, the more powerful they are.
This “choosing the right model for the right task” is something we may have to get used to although many tools are integrating this into their tools. For example, if you need a simple task like writing an email, then the tool will anaylse the task and select the correct model accordingly.
I have heard online that Claude 3 is the best AI tool for writing but let’s test it out for ourselves.
Here is my prompt (Testing Claude 3 Opus)
“Write me an email to my boss asking for a raise, I am a diligent worker and have fresh ideas, come up with an analogy to help illustrate that I am professional. I work for Salesforce as a junior product manager. My salary is currently $70,000 and I would like $85,000”
And the result:
Subject: Request for a Salary Review – [Your Name]
Dear [Boss’s Name],
I hope this email finds you well. I am writing to respectfully request a review of my current salary. As a dedicated junior product manager at Salesforce, I have consistently demonstrated my commitment to the company’s success and growth.
Over the past [length of time] in my role, I have taken on additional responsibilities and have contributed significantly to our team’s projects. My fresh ideas and innovative approaches have helped streamline processes and improve our product offerings. I have also received positive feedback from both colleagues and clients regarding my professionalism and work ethic.
To illustrate my dedication, I would like to draw an analogy. Just as a gardener nurtures and cultivates plants to ensure they grow strong and bear fruit, I have been diligently nurturing my skills and knowledge to contribute to the growth and success of Salesforce. My efforts have yielded positive results, and I am confident that I will continue to produce valuable outcomes for the company.
Considering my contributions, increased responsibilities, and the current market rates for junior product managers with my level of experience, I believe that a salary increase from $70,000 to $85,000 would be appropriate and well-deserved. This adjustment would not only align my compensation with industry standards but also reflect my value to the organization.
I am grateful for the opportunities Salesforce has provided me, and I look forward to continuing to grow with the company. I would appreciate the opportunity to discuss this request with you further and provide any additional information you may require.
Thank you for your time and consideration.
Best regards, [Your Name] Junior Product Manager Salesforce
I have to say that this is an excellent email. Apart from the analogy which I thought might be a difficult task, it is probably at the same level if not better than the email most people would write. The analogy is ok but doesn’t seem that relevant.
But will your boss know you used AI to write your emails for you?
Well, let’s test it with our AI detection tool:
I really thought this one wouldn’t be detected as AI as the language does not sound like AI to me but our AI detection tool Winston AI has a 99.98% accuracy rate when detecting AI so I should never have doubted it!
In my opinion, Claude should be used when you need high-quality writing or code. Claude lacks some of the features that Gemini and GPT4 have like being connected to the internet, image generation, and custom GPTs.
If you need more up-to-date information, then I wouldn’t recommend Claude.
GPT 4 Advantages and Disadvantages
GPT 4 is open AI’s premium model that you need to pay for. The free version of ChatGPT uses GPT3.5.
Let’s try the same prompt in ChatGPT Plus (GPT4)
Dear [Boss’s Name],
I hope this message finds you well. I am writing to discuss my current role and compensation, reflecting on my contributions and the value I’ve added to our team since joining Salesforce.
As a junior product manager, I have consistently demonstrated a strong commitment to our goals and have eagerly embraced opportunities to bring fresh ideas to the table. To draw an analogy, consider my role as that of a gardener. Just as a gardener nurtures plants through various seasons, ensuring their growth and bloom, I too have cultivated our projects with dedication, helping them to thrive and align with our strategic objectives.
Over the past year, I have led initiatives that resulted in [mention any specific achievements or increases in productivity, revenue, etc.]. My efforts in enhancing our product offerings and streamlining processes underscore my direct impact on our success.
Given these contributions, I would like to discuss the possibility of adjusting my salary to reflect the industry standards and the value I bring to our team. I believe that an increase to $85,000 would be a more accurate representation of the role I’ve grown into and the results I’ve delivered.
I am keen to continue my journey here at Salesforce, driving innovation and efficiency within our projects. I would appreciate the opportunity to meet with you to discuss this further at your earliest convenience.
Thank you for considering my request. I look forward to your positive response and to a continued fruitful association with our team.
Best regards,
[Your Name] [Your Position] [Your Contact Information]
The writing that GPT is good but there is too much fluff in this email.
The interesting thing about using AI for writing is that the effort is not in thinking and typing out every word but rather trying to get the AI tool to be more succinct.
To write clearly and convey a message that the reader can understand.
You can see this even more clearly when you ask GPT3.5 with the same prompt. The email is longer and takes more brain power to understand the message.
For me, the benefits of the premium plan in ChatGPT are the fact that you can connect to the internet and easily generate AI images.
This also returned a 0% Human score when detected with Winston AI.
Google Gemini Advantages and Disadvantages
Google doesn’t want to be left out of the AI party and they have released Google Gemini. To be honest, I am using Gemini more and more. I find the output quality better than ChatGPT at times.
Let’s test out the same prompt and see the quality of the writing:
Subject: Request for Salary Review
Dear [Boss’s Name],
I’d like to request a meeting to discuss my current compensation as Junior Product Manager. I’ve thoroughly enjoyed my time at Salesforce and continue to be dedicated to contributing to our product innovation.
Since joining the team, I believe I’ve been a consistently diligent worker. I take pride in meeting objectives on time and strive to propose fresh ideas that enhance our product offerings. Much like a finely tuned machine, I operate with precision and a focus on quality outcomes.
Considering my performance and contributions, I believe a salary increase to $85,000 is warranted. I’m confident I can continue to add value and am eager to discuss how I can further support the team’s goals.
Would you be available for a brief meeting to discuss this further? I’m open to your schedule.
Thank you for your time and consideration.
Sincerely,
[Your Name]
This email is quite different to the others. It is more direct and more confident than the others. The other two are more formal.
This time instead of stating that it would use an analogy, it just went ahead and gave one even if it still wasn’t very good. I feel like the phrasing is more suitable but it still lacks in getting te essence of what we are trying to achieve.
The email from Gemini also scored 0% human written content in our AI Detector
Pricing of AI tools
To use all three of these tools you may need to upgrade to a paid plan.
- Gemini is free but they have Gemini Advanced which costs $19.99 per month
- ChatGPT 4 also costs $20 per month.
- Claude 3 is available with Claude pro which also costs $20 per month.
Final Thoughts
I highly recommend trying out all three tools to see which one suits your needs the best. I feel like there will be a subjective bias and any review should take that into account.
The differences between the tools are marginal and the three tools are good for most tasks but I find Gemini uses language that is the most similar to the way I write (Try asking for a tweet and you’ll see what I mean!).
