Talk:Gittins index

Untitled

I don't think the discussion regarding the selection of technologies is relevant to the Gittins index itself. Investing in technologies is not really parallel to the N-armed bandit problem except at a superficial and probably artificial level. 165.125.144.16 (talk) 19:46, 11 September 2009 (UTC)

I think you are right, but this example appears often in relation with the Multi-armed bandit process. Indeed what one does in the selection of technologies is to gather information in a bayesian way and the states of the process are probability distributions, which are called belief state. There is an algorithm for computing the Gittins index in such a setup but it is quite complex and I agree that it would be just misleading in an introductory example. Pychron (talk) 00:42, 28 November 2009 (UTC)

Article's name

Shouldn't Gittins' have an apostrophe? Henriqueroscoe (talk) 14:48, 11 June 2010 (UTC)

Well, in the literature it does not, example Pychron (talk) 19:44, 18 June 2010 (UTC)

Editor Pychron is correct that the literature refers to the "Gittins index", just as mathematical literature referes to Hilbert space, Hardy space, Haar system, Haar measure (Hardy-Haar-Haar), Wald test, etc. Mathematical and scholarly practice differ from the recommendation of Strunk and White, who prescribe an apostrophe for forming the possessive for proper names (save Jesus and Moses). Cheers, Kiefer.Wolfowitz (talk) 10:20, 19 June 2010 (UTC)

Correct interpretation of Exploration vs Exploitation

The section "terminology" mentions a Bernoulli process with unknown probabilities. I would remove that reference: the basic Gittins index deals with processes whose probabilistic structure is known. The classical example of explotiation vs exploration refers to projects in which the course is unknown but the odds for every decision stage are known. Pychron (talk) 14:13, 12 August 2010 (UTC)

Citations

The references [7] and [8] are different papers on the same place. Jj14 (talk) 12:43, 9 February 2016 (UTC)

I don't get this, could you get more explicit? Pychron (talk) 13:25, 21 March 2016 (UTC)

ref 7,8,9:

Chen, Y.R. and Katehakis, M.N. (1986). "Linear programming for finite state multi-armed bandit problems", Math. Oper. Res., 11(1), 262–268

Kallenberg, L.C.M.(1986). "A Note on MN Katehakis' and Y.-R. Chen's Computation of the Gittins Index", Math. Oper. Res., 11(1), 262–268

Katehakis, M., Veinott, A. (1987). "The multi-armed bandit problem: decomposition and computation." Math. Oper. Res., 12(2), 262–268

Jj14 (talk) 23:41, 16 August 2016 (UTC)

Thank you, I have fixed it. Pychron (talk) 15:48, 3 November 2016 (UTC)