Sample Efficient Paradigms for Personalized Assessment of Taskable AI Systems

Pulkit Verma

Abstract

The vast diversity of internal designs of taskable black-box AI systems and their nuanced zones of safe functionality make it difficult for a layperson to use them without unintended side effects. The focus of my dissertation is to develop paradigms that would enable a user to assess and understand the limits of an AI system's safe operability. We develop a personalized AI assessment module that lets an AI system execute instruction sequences in simulators and answer queries about these executions. Our results show that such a primitive query-response capability is sufficient to efficiently derive a user-interpretable model of the system's capabilities in fully observable settings.
BibTeX
@inproceedings{verma2023sample,
  author = {Pulkit Verma},
  title = {{Sample Efficient Paradigms for Personalized Assessment of Taskable AI Systems}},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year = {2023},
  doi = {10.24963/ijcai.2023/824},
}

Loading related content...

Figure