Optiver Interview Question

One similar to Multi Armed Bandit Problem