Signature of Rakshya Pandey
Rakshya Pandey·Feb 18, 2025
Paper Reading - PARROT: Efficient Serving of LLM-based Applications with Semantic Variable
Paper https://www.usenix.org/conference/osdi24/presentation/lin-chaofan Parrot is a system designed to optimize the end-to-end performance of LLM-based applicat
14 min read·General
Rakshya Pandey·Feb 13, 2025
What is an attention score?
An attention score refers to a value that quantifies how much focus or importance a model assigns to a specific element within an input sequence.It is a numeric
3 min read·General