openlogprobs
Openlogprobs is a Python API that uses specific algorithms to uncover log-probabilities from language model APIs, often hidden due to security reasons and data size limitations. Utilizing logit bias adjustments and methods like binary search, it efficiently extracts full probability vectors from APIs such as OpenAI's. It offers methods like 'topk', 'exact', and 'binary search' based on API capabilities, making it ideal for researchers and developers interested in understanding AI model outputs. Besides, it contributes to notable academic papers like 'Language Model Inversion'.