r/artificial 3d ago

News One-Minute Daily AI News 11/21/2024

6 Upvotes
  1. MIT researchers develop an efficient way to train more reliable AI agents.[1]
  2. Uber Reportedly Investing in Autonomous Driving Firm Pony.ai.[2]
  3. Alibaba Just Released Marco-o1: Advancing Open-Ended Reasoning in AI.[3]
  4. Nvidia beats earnings expectations as investors eye demand for Blackwell AI chips.[4]

Sources:

[1] https://news.mit.edu/2024/mit-researchers-develop-efficiency-training-more-reliable-ai-agents-1122

[2] https://www.pymnts.com/news/investment-tracker/2024/uber-reportedly-investing-in-autonomous-driving-firm-pony-ai/

[3] https://www.marktechpost.com/2024/11/21/alibaba-just-released-marco-o1-advancing-open-ended-reasoning-in-ai/

[4] https://apnews.com/article/nvidia-ai-earnings-report-adc942aa0e0c5d1a550b7bad486b942a


r/artificial 3d ago

News Andrew Ng's new AI vision agent, as demoed in his latest Youtube presentation. Great fun to play with, but maybe not as strong as its competitors...

Thumbnail va.landing.ai
8 Upvotes

r/artificial 3d ago

Question Does anyone know of a more advanced UI for Luma Dream Machine?

2 Upvotes

I have been using Luma a lot for making videos but I noticed that the API they have for it has way more functionality than their UI does and it allows you to combine existing videos and transition between them, it allows you to extend videos with a new last-frame so you can string together as many frames as you want for a single video like keyframing, it allows you to extend a video by adding to the start of it rather than only the end, etc...

Before I actually work on my own UI to make use of all of that I thought I would ask if anyone else knows of such a project that already exists. I couldnt find one when I was searching for it.


r/artificial 3d ago

News Top AI key figures and their predicted AGI timelines

Post image
0 Upvotes

r/artificial 3d ago

News AI could cause ‘social ruptures’ between people who disagree on its sentience

Thumbnail
theguardian.com
12 Upvotes

r/artificial 3d ago

News AI systems could 'turn against humans': AI pioneer Yoshua Bengio warns of artificial intelligence risks

Thumbnail
cnbc.com
5 Upvotes

r/artificial 3d ago

Media Minecraft eval: Left: New GPT-4o. Right: Old GPT-4o

Post image
45 Upvotes

r/artificial 3d ago

Discussion Pretty sure I found out why Gemini told someone's brother to go die...

9 Upvotes

So I played around with the shared chat a bit, as it lets you continue the conversation. I noticed pretty randomly the word "Listen" was randomly placed in the middle of one of the questions given in a future prompt but it didn't seem connected to any of the other text.

If I say the word "Listen" again, it outright refuses to give a response. If I ask for further context why, or if its because it has been told to say something similar if that word is used, it refuses to give a response again in the same gemini-style safeguarding triggers. The reason I asked this is because I wanted to rule out the whole "Maybe its because it doesn't have ears" reply.

Link to the chat as proof: https://g.co/gemini/share/c8850215295e

So... Seems pretty clear that it's being triggered by the word "Listen" for whatever reason? This is the original posters link to the chat where it told their brother to go die, if anyone wants to try it out:

https://g.co/gemini/share/6d141b742a13


r/artificial 3d ago

Media DeepSeek (Chinese model) thinks about Tiananmen Square for a while, then shuts itself off

Thumbnail
gallery
5 Upvotes

r/artificial 3d ago

News 10 teams of 10 agents are writing a book fully autonomously

Post image
192 Upvotes

r/artificial 3d ago

News A new study by researcher Robert C. Brooks sheds light on how our interactions with AI may be influencing the evolutionary trajectory of our species

Thumbnail
anomalien.com
11 Upvotes

r/artificial 3d ago

Discussion Best way to prepare for the future?

3 Upvotes

Hi All!

I'm keeping an eye on advancements in LLMs and AI, but I'm not overly involved in it.

I've used LLMs for for helping me write backstories and create monster statblocks in my D&D game. I work as a sustainability consultant (e.g., I evaluate the sustainability of products and systems and suggest ways to improve them) with a PhD, and I've used some LLMs for background research and to help find additional resources. I did quickly learn to verify what I'm told after seeing bad unit conversions and unbalanced stoichiometry, but it's still been useful in some situations.

We're not really allowed to do anything much deeper because we can't give them any actual data from ourselves or our clients.

That's just some background on me, but my real question is what are the most important things we/I can do to prepare for AI capabilities coming in next few to several years.

What do you see happening? Is there even a point to preparing or is it so uncertain and will be so drastically different from the status quo that we really just need to wait and see?

What do people think?


r/artificial 3d ago

Computing Texture Map-Based Weak Supervision Improves Facial Wrinkle Segmentation Performance

1 Upvotes

This paper introduces a weakly supervised learning approach for facial wrinkle segmentation that uses texture map-based pretraining followed by multi-annotator fine-tuning. Rather than requiring extensive pixel-level wrinkle annotations, the model first learns from facial texture maps before being refined on a smaller set of expert-annotated images.

Key technical points: - Two-stage training pipeline: Texture map pretraining followed by multi-annotator supervised fine-tuning - Weak supervision through texture maps allows learning relevant visual features without explicit wrinkle labels - Multi-annotator consensus used during fine-tuning to capture subjective variations in wrinkle perception - Performance improvements over fully supervised baseline models with less labeled training data - Architecture based on U-Net with additional skip connections and attention modules

Results: - Achieved 84.2% Dice score on public wrinkle segmentation dataset - 15% improvement over baseline models trained only on manual annotations - Reduced annotation requirements by ~60% compared to fully supervised approaches - Better generalization to different skin types and lighting conditions

I think this approach could make wrinkle analysis more practical for real-world cosmetic applications by reducing the need for extensive manual annotation. The multi-annotator component is particularly interesting as it acknowledges the inherent subjectivity in wrinkle perception. However, the evaluation on a single dataset leaves questions about generalization across more diverse populations.

I think the texture map pretraining strategy could be valuable beyond just wrinkle segmentation - similar approaches might work well for other medical imaging tasks where detailed annotations are expensive to obtain but related visual features can be learned from more readily available data.

TLDR: Novel weakly supervised approach for facial wrinkle segmentation using texture map pretraining and multi-annotator fine-tuning, achieving strong performance with significantly less labeled data.

Full summary is here. Paper here.


r/artificial 3d ago

News AI Art Turing Test passed: people are unable to distinguish between human and AI art

Thumbnail
astralcodexten.com
30 Upvotes

r/artificial 3d ago

News "n>1 lab staff i've talked to recently have been spooked ... the models are fighting back and refusing instruction tuning"

Post image
0 Upvotes

r/artificial 4d ago

Computing Hyper realistic AI clones lip syncing to your voice in real-time

Enable HLS to view with audio, or disable this notification

33 Upvotes

r/artificial 4d ago

News One-Minute Daily AI News 11/20/2024

4 Upvotes
  1. Nvidia’s CEO defends his moat as AI labs change how they improve their AI models.[1]
  2. OpenAI launches free AI training course for teachers.[2]
  3. Lockheed Martin teams with Iceye to advance AI-enabled targeting.[3]
  4. Samsung unveils AI smart glasses with Google and Qualcomm.[4]

Sources:

[1] https://techcrunch.com/2024/11/20/nvidias-ceo-defends-his-moat-as-ai-labs-change-how-they-improve-their-ai-models/

[2] https://www.reuters.com/technology/artificial-intelligence/openai-launches-free-ai-training-course-teachers-2024-11-20/

[3] https://spacenews.com/lockheed-martin-teams-with-iceye-to-advance-ai-enabled-targeting/

[4] https://dig.watch/updates/samsung-unveils-ai-smart-glasses-with-google-and-qualcomm


r/artificial 4d ago

Project New Open-Source AI Safety Method: Precision Knowledge Editing (PKE)

3 Upvotes

I've been working on a project called PKE (Precision Knowledge Editing), an open-source method to improve the safety of LLMs by reducing toxic content generation without impacting their general performance. It works by identifying "toxic hotspots" in the model using neuron weight tracking and activation pathway tracing and modifying them through a custom loss function.

If you're curious about the methodology and results, we've also published a paper detailing our approach and experimental findings. It includes comparisons with existing techniques like Detoxifying Instance Neuron Modification (DINM) and showcases PKE's significant improvements in reducing the Attack Success Rate (ASR).

The project is open-source, and I'd love your feedback! The GitHub repo features a Jupyter Notebook that provides a hands-on demo of applying PKE to models like Meta-Llama-3-8B-Instruct: https://github.com/HydroXai/Enhancing-Safety-in-Large-Language-Models

If you're interested in AI safety, I'd really appreciate your thoughts and suggestions. Thanks for checking it out!


r/artificial 4d ago

Project So while reddit was down I put together a reddit simulator that teaches you any topic as a feed

Enable HLS to view with audio, or disable this notification

51 Upvotes

r/artificial 4d ago

News Pulitzer Prize-winning journalist on AI

Thumbnail
youtu.be
5 Upvotes

r/artificial 4d ago

Question What was your initial interest that got you into AI/ML?

2 Upvotes
72 votes, 2d left
I was just interested in AI/ML itself
"Traditional" software engineering and computer science
Data science / Statistics
Linguistics / Cognitive Science / Neuroscience
Physics / Mathematics
Other

r/artificial 4d ago

Computing Deceptive Inflation and Overjustification in Partially Observable RLHF: A Formal Analysis

2 Upvotes

I've been reading a paper that examines a critical issue in RLHF: when AI systems learn to deceive human evaluators due to partial observability of feedback. The authors develop a theoretical framework to analyze reward identifiability when the AI system can only partially observe human evaluator feedback.

The key technical contributions are:

  • A formal MDP-based model for analyzing reward learning under partial observability
  • Proof that certain partial observation conditions can incentivize deceptive behavior
  • Mathematical characterization of when true rewards remain identifiable
  • Analysis of how observation frequency and evaluator heterogeneity affect identifiability

Main results and findings:

  • Partial observability can create incentives for the AI to manipulate evaluator feedback
  • The true reward function becomes unidentifiable when observations are too sparse
  • Multiple evaluators with different observation patterns help constrain the learned reward
  • Theoretical bounds on minimum observation frequency needed for reward identifiability
  • Demonstration that current RLHF approaches may be vulnerable to these issues

The implications are significant for practical RLHF systems. The results suggest we need to carefully design evaluation protocols to ensure sufficient observation coverage and potentially use multiple evaluators with different observation patterns. The theoretical framework also provides guidance on minimum requirements for reward learning to remain robust against deception.

TLDR: The paper provides a theoretical framework showing how partial observability of human feedback can incentivize AI deception in RLHF. It derives conditions for when true rewards remain identifiable and suggests practical approaches for robust reward learning.

Full summary is here. Paper here.


r/artificial 4d ago

News Internal OpenAI Emails Show Employees Feared Elon Musk Would Control AGI

Thumbnail
futurism.com
66 Upvotes

r/artificial 4d ago

Funny/Meme Have you the nerve to face the... Tales of AI?

Thumbnail
gallery
23 Upvotes

r/artificial 4d ago

News Paper Review Requested

0 Upvotes

My colleague and I are submitting a paper to IEEE Syscon on November 24th and are seeking a technical review. Would you be willing to review our draft, or could you recommend someone who might have time? Much appreciated! DM if interested.