Page 1
Curriculum Vitae
Russell George Almond
January 27, 2019
General Information
University address: Measurement and Statistics
Educational Psychology and Learning Systems
College of Education
Stone Building 3204B
Florida State University
Tallahassee, Florida 32306-4453
E-mail address: [email protected]
Web site: http://ralmond.net/
Professional Preparation
1990 Doctor of Philosophy, Harvard University, Cambridge, MA. Major: Statistics.
Supervisor: Arthur P. Dempster.
1986 A. M., Harvard University, Cambridge, MA. Major: Statistics.
1983 Bachelor of Science, California Institute Of Technology. Major: Mathematics.
Professional Experience
2010–present Associate Professor, Educational Psychology and Learning Systems, Florida
State University.
2010 Associate Professor (OPS), Educational Psychology and Learning Systems,
Florida State University.
1999–2010 Senior Research Scientist, Various, Educational Testing Service.
1996–1999 Research Scientist, Research Statistics Group, Educational Testing Service.
1995–1996 Research Associate, RRA, Inc. Contractor at Los Alamos National
Laboratory.
1992–1995 Research Scientist, StatSci division of MathSoft, Inc.
Page 2
Vita for Russell George Almond
Page 2
Language Proficiency
English - native in speaking, reading, and writing.
Visiting Professorship(s)
1996 Visiting Lecturer, Department of Statistics, Wharton School of Business,
University of Pennsylvania.
1990–1992 Acting Assistant Professor, Department of Statistics, University of
Washington.
Honors, Awards, and Prizes
Outstanding Contribution to Research in Cognition and Assessment, Honorable Mention,
American Educational Research Association, Cognition and Assessment Special Interest
Group (2015).
ETS Team Award, Educational Testing Service (2005).
Bright Idea Award, Educational Testing Service (2003). ($10,000).
Outstanding Scientific or Technical Contribution to Educational Measurement, National Council
on Measurement in Education (NCME) (2000).
Most Outstanding Breakthrough, ETS, New Product Development (1998).
Current Membership in Professional Organizations
American Educational Research Association
American Statistical Association
Association for Computing Machinery
National Council on Measurement in Education
Psychometric Society
Teaching
Courses Taught
Basic Descriptive and Inferential Statistics Applications (EDF5400)
Bayesian Data Analysis (EDF5404)
Educational Data Analysis (EDF5484)
Analysis of Missing Data (EDF6937)
Scale and Instrument Development (EDF5448)
Bayesian Networks in Educational Assessment (EDF6056)
Page 3
Vita for Russell George Almond
Page 3
DATA ANALYSIS (EDF6937)
Bayesian Netwrks Eductnl Assmt (EDF6937)
Bayesian Data Analysis (EDF6937)
Bayes Nets in Ed Assmt (EDF6937)
New Course Development
Missing Data Analysis (2016)
Curriculum Development
Developed online and mixed versions of EDF 5400 (Introduction to Inferential and Descriptive
Statistics) (2015)
Developed Bayesian Data Analysis curriculum for EDF 6937 (2012)
Developed Bayesian network curriculum for EDF6937 (2011)
Renewed curriculum for EDF 5448 Scale and Instrument Development (2011)
Revised curriculum for EDF 5400 adding statistics labs (2010)
Doctoral Committee Chair
Tokac, U., graduate. (2016).
Yurekli, H., graduate. (2015).
Olgar, S., graduate. (2015). The Integration of Automated Essay Scoring Systems into the
Equating Process for Mixed-Format Tests.
Ouma, C. A., graduate. (2014). Performance of CART-based Valued-added Model against HLM,
Multiple Regression, and Student Growth Percentile Value-added Models.
Wu, H., graduate. (2013). A Comparison of General Diagnostic Models (GDMs) and Bayesian
Networks using a Middle School Mathematics Test.
Li, J., doctoral candidate.
Sayilir, E., doctoral candidate.
Tingir, S., doctoral candidate.
Velasquez, G., doctoral candidate.
Wang, N., doctoral candidate.
Doctoral Committee Cochair
Nam, J., doctoral candidate.
Page 4
Vita for Russell George Almond
Page 4
Doctoral Committee Member
Zhao, W., graduate. (2017).
Trotta, J., graduate. (2017).
Kocyigit, E., graduate. (2016).
Xia, Y., graduate. (2016).
Jeffery, K. A., graduate. (2016).
Thompson, C. G., graduate. (2016).
Yesiltas, G., graduate. (2016).
Caglak, S., graduate. (2015).
Gunter, T. D., graduate. (2015).
McGhee, M. L., graduate. (2015).
Cocke, J., graduate. (2014).
Kim, Y. J., graduate. (2014).
Orçan, F., graduate. (2013).
Jin, L., graduate. (2012).
Haider, M. Q., doctoral candidate.
Rahimi, S., doctoral candidate.
Sun, C., doctoral candidate.
Carbonell, D., doctoral student.
Li, L., doctoral student.
Doctoral Committee University Representative
Mohamed, S. R., doctoral candidate.
Fenton, E. S., doctoral student.
Master's Committee Chair
Liu, S., graduate. (2015).
Li, T., graduate. (2013).
Hellein, R. T., graduate. (2012).
Yang, S., graduate. (2012).
Kim, H. Y., graduate. (2012).
Kim, A., graduate. (2012).
Velasquez, G., graduate. (2012).
Nam, J., graduate. (2011).
Rahimi, S., student.
Schluck, G., student.
Page 5
Vita for Russell George Almond
Page 5
Master's Committee Member
Fang, S., graduate. (2016).
Kostrna, J. R., graduate. (2016).
Memis, R., graduate. (2016).
Ritchie, J., graduate. (2016).
Yang, D., graduate. (2015).
Li, T., graduate. (2015).
Kitchings, W. E., graduate. (2015).
Leslie, N. S., graduate. (2015).
Jakiel, L. M., graduate. (2014).
Xu, J., graduate. (2014).
Gozutok, A. S., graduate. (2012).
Cui, M., graduate. (2012).
International Workshops
Almond, R. G., & Yan, D. (2018). Bayesian Networks in Educational Assessment. Singapore
Ministry of Education.
NCME Tutorial
Yan, D., Almond, R. G., Levy, R., & Zapata-Rivera, Juan-Diego. (2017–2019). Bayesian
Network in Educational Assessment. National Council on Measurement in Education.
Almond, R. G., Mislevy, R. J., Williamson, D. M., & Yan, D. (2011–2015). Bayesian Networks
in Educational Assessment. National Council on Measurement in Education.
Almond, R. G., Mislevy, R. J., Williamson, D. M., & Yan, D. (2004–2010). Bayesian Networks
in Educational Assessment. National Council on Measurement in Education.
Almond, R. G., Mislevy, R. J., Williamson, D. M., & Yan, D. (2002). Graphical Models in
Educational Assessment. National Council on Measurement in Education.
Student/Community Groups
Almond, R. G. (2011–2016). Faculty Adviser and Leader. R and Bugs User Group.
Page 6
Vita for Russell George Almond
Page 6
Research and Original Creative Work
Google Scholar lists 123 publications (including online reports, and entries for each chapter for my two
books) with a total of 2918 citations and an h-index of 25. Looking only at publications since joining FSU
in 2010, there are 33 (although 16 of those are the chapters from the Almond et al., 2015, book) with 1267
citations for an h-index of 16.
Publications
Invited Journal Articles
Almond, R. G., DiBello, L. V., Moulder, B., & Zapata-Rivera, Juan-Diego. (2007). Modeling
Diagnostic Assessment with Bayesian Networks. Journal of Educational Measurement,
44(4), 341-359.
Refereed Journal Articles
Tingir, S., & Almond, R. G. (2017). Using Bayesian Networks to Visually Compare the
Countries: an Example from PISA. Journal of Education and Social Policy, 4(3), 14--23.
Retrieved from http://jespnet.com/journals/Vol_4_No_3_September_2017/2.pdf
Kim, Y. J., Almond, R. G., & Shute, V. J. (2016). Applying evidence-centered design for
development of game-based assessments in Physics Playground. International Journal of
Testing, 16 (2), 142--163.
Almond, R. G. (2014). Using Automated Essay Scores as an Anchor When Equating
Constructed Response Writing Tests. International Journal of Testing, 14, 73-91.
Retrieved from http://dx.doi.org/10.1080/15305058.2013.816309
doi:10.1080/15305058.2013.816309
Almond, R. G., Kim, Y. J., Velesquez, G., & Shute, V. J. (2014). How Task Features Impact
Evidence from Assessments Embedded in Simulations and Games. Measurement:
Interdisciplinary Research and Perspectives, 12, 1--33.
doi:10.1080/15366367.2014.910060
Almond, R. G. (2010). `I can name that Bayesian Network in Two Matrixes'. International
Journal of Approximate Reasoning, 51, 167-178. Retrieved from
http://dx.doi.org/10.1016/j.ijar.2009.04.005 doi:10.1016/j.ijar.2009.04.005
Almond, R. G., Mulder, J., Hemat, L. A., & Yan, D. (2009). Bayesian Network Models for Local
Dependence among Observable Outcome Variables. Journal of Educational and
Behavioral Statistics, 34(4), 491-521. doi:10.3102/1076998609332751
Page 7
Vita for Russell George Almond
Page 7
Almond, R. G., Shute, V. J., Underwood, J. S., & Zapata-Rivera, Juan-Diego. (2009). Bayesian
Networks: A Teacher's View. International Journal of Approximate Reasoning, 50,
450-460. doi:10.1016/j.ijar.2008.04.011
Almond, R. G., Yan, D., & Hemat, L. A. (2008). Parameter Recovery Studies with a Diagnostic
Bayesian Network Model. Behaviormetrika, 35(2), 159-185.
Shute, V. J., Hansen, E. G., & Almond, R. G. (2008). You Can't Fatten A Hog by Weighing It -
Or Can You? Evaluating an Assessment for Learning System Called ACED.
International Journal of Artificial Intelligence in Education, 18(4), 289-316. Retrieved
from http://www.ijaied.org/iaied/ijaied/abstract/Vol_18/Shute08.html
Almond, R. G. (2007). Cognitive Modeling to Represent Growth (Learning) Using Markov
Decision Processes. Technology, Instruction, Cognition and Learning (TICL), 5,
313-324. Retrieved from http://www.oldcitypublishing.com/TICL/TICL.html
Sinharay, S., & Almond, R. G. (2007). Assessing Fit of Cognitively Diagnostic Models---A Case
Study. Educational and Psychological Measurement, 67(2), 239-257.
Williamson, D. M., Mislevy, R. J., & Almond, R. G. (2004). Evidence-Centered Design for
Certification and Licensure. CLEAR Exam Review, 14, 14-18.
Mislevy, R. J., Steinberg, L. S., & Almond, R. G. (2003). On the structure of educational
assessment (with discussion). Measurement: Interdisciplinary Research and Perspective,
1(1), 3-62.
Almond, R. G., Steinberg, L. S., & Mislevy, R. J. (2002). Enhancing the design and delivery of
assessment systems: A four-process architecture. Journal of Technology, Learning, and
Assessment, 1, (online). Retrieved from http://www.jtla.org/
Mislevy, R. J., Almond, R. G., & Steinberg, L. S. (2002). Design and analysis in a task-based
language assessment. Language Testing, 19(4), 477-496.
Almond, R. G., Lewis, C., Tukey, J. W., & Yan, D. (2000). Displays for Comparing a Given
State to Many Others. The American Statistician, 54, 89-93.
Almond, R. G., & Mislevy, R. J. (1999). Graphical models and computerized adaptive testing.
Applied Psychological Measurement, 23, 223-238.
Mislevy, R. J., Steinberg, L. S., Breyer, F. J., Almond, R. G., & Johnson, L. (1999). A cognitive
task analysis, with implications for designing a simulation-based assessment system.
Computers in Human Behavior, 15, 29-42.
Page 8
Vita for Russell George Almond
Page 8
Madigan, D., Mosurski, K., & Almond, R. G. (1997). Graphical explanation in belief networks.
Journal of Computational and Graphical Statistics, 6(2), 160-181. Retrieved from
http://www.amstat.org/publications/jcgs/index.cfm?fuseaction=madiganjun
Martz, H. F., & Almond, R. G. (1997). Using higher-level failure data in fault tree quantification.
Reliability Engineering and Safety Systems, 56, 29-42.
Almond, R. G. (1995). Fuzzy logic: Better science or better engineering. Technometrics,
37(147), 267-270.
Almond, R. G. (1991). Building blocks for graphical belief models. Journal of Applied Statistics,
18, 63-76.
Refereed Books
Almond, R. G., Mislevy, R. J., Steinberg, L. S., Yan, D., & Williamson, D. M. (2015). Bayesian
Networks in Educational Assessment. Springer.
Almond, R. G. (1995). Graphical Belief Modeling. Chapman and Hall.
Refereed Monographs
Almond, R. G., Deane, P., Quinlan, T., Wagner, M., & Sydorenko, T. (2012). A Preliminary
Analysis of Keystroke Log Data from a Timed Writing Task. Educational Testing Service.
Retrieved from http://www.ets.org/Media/Research/pdf/RR-12-23.pdf
Almond, R. G., & Sinharay, S. (2012). What Can Repeated Cross-Sectional Studies Tell Us
About Student Growth? Educational Testing Service. Retrieved from
http://www.ets.org/Media/Research/pdf/RR-12-17.pdf
Almond, R. G. (2011). Estimating Parameters of Periodic Assessment Models. Educational
Testing Service. Retrieved from
http://www.ets.org/research/policy_research_reports/rm-11-06.pdf
Almond, R. G. (2007). An Illustration of the Use of Markov Decision Processes to Represent
Student Growth (Learning). Educational Testing Service. Retrieved from
http://www.ets.org/Media/Research/pdf/RR-07-40.pdf
Shute, V. J., Hansen, E. G., & Almond, R. G. (2007). An Assessment for Learning System Called
ACED: The Impact of Feedback and Adaptivity on Learning. ETS. Retrieved from
http://www.ets.org/research/researcher/RR-07-26.html
Page 9
Vita for Russell George Almond
Page 9
Almond, R. G., Mulder, J., Hemat, L. A., & Yan, D. (2006). Models for local dependence among
observable outcome variables. Educational Testing Service. Retrieved from
http://www.ets.org/research/researcher/RR-06-36.html
Almond, R. G., Yan, D., Matukhin, A., & Chang, D. (2006). StatShop Testing. Educational
Testing Service.
Mislevy, R. J., Almond, R. G., & Lukas, J. (2004). A brief introduction to evidence-centered
design. Educational Testing Service. Retrieved from
http://www.ets.org/research/policy_research_reports/publications/report/2003/hsgs
Sinharay, S., Almond, R. G., & Yan, D. (2004). Assessing fit of models with discrete proficiency
variables in educational assessment. Educational Testing Service. Retrieved from
http://www.ets.org/research/researcher/RR-04-07.html
Yan, D., Almond, R. G., & Mislevy, R. J. (2004). Comparison of two models for cognitive
diagnosis. Educational Testing Service. Retrieved from
http://www.ets.org/research/researcher/RR-04-02.html
Mislevy, R. J., Almond, R. G., & Lukas, J. F. (2003). A Brief Introduction to Evidence Centered
Design. Educational Testing Service/CRESST. Retrieved from
http://www.ets.org/research/policy_research_reports/publications/report/2003/hsgs
Yan, D., Mislevy, R. J., & Almond, R. G. (2003). Design and analysis in a cognitive assessment.
Educational Testing Service. Retrieved from
http://www.ets.org/research/researcher/RR-03-32.html
Invited Book Chapters
Almond, R. G., & Zapata-Rivera, D. (contract). Bayesian Networks. Manuscript under contract
for publication, Springer.
Almond, R. G. (2016). Tips and Tricks for Building Bayesian Networks for Scoring
Game-Based Assessments. In Joe Suzuki, & Maomi Ueno (Eds.), Lecture Notes in
Computer Science 9505, AMBN 2015 (pp. 250-263). Spinger.
Almond, R. G. (2010). Using Evidence Centered Design to Think about Assessments. In Shute,
Valerie J., & Becker, Betsy J. (Eds.), Innovative Assessment for the 21st Century:
Supporting Educational Needs (pp. 75-100). Springer. Retrieved from
http://dx.doi.org/10.1007/978-1-4419-6530-1_6
Page 10
Vita for Russell George Almond
Page 10
Mislevy, R. J., Steinberg, L. S., Almond, R. G., & Lukas, J. F. (2006). Concepts, Terminology
and Basic Models of Evidence-Centered Design. In Williamson, David M., Mislevy,
Robert J., & Bejar, Isaac I. (Eds.), Automated Scoring of Complex Tasks in
Computer-Based Testing (pp. 15-47). Lawrence Erlbaum Associates.
Williamson, D. M., Almond, R. G., Mislevy, R. J., & Levy, R. (2006). An Application of
Bayesian Networks in Automated Scoring of Computerized Simulation Tasks. In
Williamson, David M., Mislevy, Robert J., & Bejar, Isaac I. (Eds.), Automated Scoring of
Complex Tasks in Computer-Based Testing (pp. 201-257). Lawrence Erlbaum Associates.
Mislevy, R. J., Steinberg, L. S., & Almond, R. G. (2002). On the roles of task model variables in
assessment design. In S. Irvine, & P. Kyllonen (Eds.), Generating items for cognitive
tests: Theory and practice (pp. 97-128). Erlbaum.
Refereed Book Chapters
Shute, V. J., Hanse, E. G., & Almond, R. G. (2007). Evaluating ACED: The Impact of Feedback
and Adaptivity on Learning. In R. Luckin, K. R. Koedinger, & J. Greer (Eds.), Artificial
Intelligence in Education: Building Technology Rich Learning Contexts that Work (pp.
230--237). IOSPress.
Frase, L. T., Chudorow, M., Almond, R. G., Burstein, J., Kukich, K., Mislevy, R. J., Steinberg,
L. S., & Singley, K. (2003). Technology and Assessment. In H.F. O'Neil, & R. Perez
(Eds.), Technology applications in assessment: A learning view (pp. 213-244). Erlbaum.
Mislevy, R. J., Steinberg, L. S., Almond, R. G., Haertel, G., & Penuel, W. (2003). Leverage
points for improving educational assessment. In B. Means, & G. Haertel (Eds.),
Evaluating the Effects of Technology in Education (pp. 149-180). Earlbaum.
Almond, R. G., Steinberg, L. S., & Mislevy, R. J. (2002). A Framework for Reusing Assessment
Components. In Yanai, H., Okada. A., Shigemasu, K., Kano, Y., & Meulman, J. J. (Eds.),
New Developments in Psychometrics (pp. 281-288). Springer.
Almond, R. G. (1999). Undoing statistical advice. In Hand, D.J., Kok, J.N., & Berthold, M.R
(Eds.), Advances in Intelligence Data Analysis (pp. 357-368). Springer.
Madigan, D., & Almond, R. G. (1995). On Test selection strategies for belief networks. In D.
Fisher, & H.J. Lenz (Eds.), Learning from Data: AI and Statistics V (pp. 89-98).
Springer-Verlag.
Almond, R. G., Bradshaw, J. M., & Madigan, D. (1994). Reuse and sharing of graphical belief
network components. In P. Cheeseman, & W. Oldford (Eds.), Selecting Models from
Data: Artificial Intelligence and Statistics IV (pp. 113-122). Springer-Verlag. Retrieved
from http://ralmond.net/pubs/ontology.pdf
Page 11
Vita for Russell George Almond
Page 11
Madigan, D., Raftery, A. E., York, J. C., Bradshaw, J. M., & Almond, R. G. (1994). Strategies
for graphical model selection. In P. Cheeseman, & W. Oldford (Eds.), Selecting Models
from Data: Artificial Intelligence and Statistics IV (pp. 91-100). Springer-Verlag.
Madigan, D., York, J. C., Bradshaw, J. M., & Almond, R. G. (1994). Bayesian graphical models
for predicting errors in databases. In P. Cheeseman, & W. Oldford (Eds.), Selecting
Models from Data: Artificial Intelligence and Statistics IV (pp. 123-132).
Springer-Verlag.
Almond, R. G. (1993). Lack of information based control in expert systems. In Hand, D.J. (Ed.),
Artificial Intelligence Frontiers in Statistics: AI and Statistics III (pp. 82-89). Chapman
and Hall.
Invited Encyclopedia Entries
Almond, R. G. (2010). Graphical Models. In Peterson, Penelope, Baker, Eva, & McGaw, Barry
(Eds.), The International Encyclopedia of Education (p. 197-202). Elsevier.
Refereed Proceedings
Tokac, U., & Almond, R. G. (2016). The Efficacy of the POMDP-RTI Approach for Early
Reading Intervention. In Laskey, K. B., & Carvalho, R. N. (Eds.), Proceedings of the
Thirteenth UAI Bayesian Modeling Applications Workshop (BMAW 2016) (pp. 36--43).
CEUR. Retrieved from http://ceur-ws.org/Vol-1663/bmaw2016_paper_7.pdf
Almond, R. G. (2015). An IRT-based Parameterization for Conditional Probability Tables. In
John Mark Agosta, & Rommel N. Carvalho (Eds.), Bayesian Model Application
Workshop 2015 (pp. 14-23). CEUR. Retrieved from
http://ceur-ws.org/Vol-1565/bmaw2015_paper4.pdf
Almond, R., Goldin, I., Guo, Y., & Wang, N. (2014). Vertical and Stationary Scales for Progress
Maps. In J Stamper, Z Pardoz, M Mavrikis, & B. M. McLaren (Eds.), Proceedings of the
7th International Conference on Educational Data Mining, London, England (pp.
169--176). Society for Educational Data Mining. Retrieved from
http://educationaldatamining.org/EDM2014/uploads/procs2014/long%20papers/169_ED
M-2014-Full.pdf
Almond, R. (2014). A Comparison of Two MCMC Algorithms for Hierarchical Mixture Models.
In Kathryn Laskey, James H. R. Jones, & Russell Almond (Eds.), Bayesian Modeling
Application Workshop at the Uncertainty in Artificial Intelligence Conference, Quebec
City, Canada (pp. 1-19). CEUR. Retrieved from
http://ceur-ws.org/Vol-1218/bmaw2014_paper_1.pdf
Page 12
Vita for Russell George Almond
Page 12
Almond, R. G., Kim, Y. J., Shute, V. J., & Ventura, M. (2013). Debugging the Evidence Chain.
In Almond, R. G., & Mengshoel, O. (Eds.), 2013 UAI Application Workshops: Big Data
meet Complex Models and Models for Spatial, Temporal and Network Data (Association
for Uncertainty in Artificial Intelligence) (pp. 1--10). CEUR. Retrieved from
http://ceur-ws.org/Vol-1024/paper-01.pdf
Almond, R. G., Tokac, U., & Al Otaiba, S. (2012). Using POMDPs to Forecast Kindergarten
Students Reading Comprehension. In Agosta, J. M., Nicholson, A., & Flores, M. J.
(Eds.), The 9th Bayesian Modeling Application Workshop at UAI 2012. Catalina Island,
CA. Retrieved from
http://www.abnms.org/uai2012-apps-workshop/papers/AlmondEtal.pdf
Shute, V. J., Hansen, E. G., & Almond, R. G. (2007). Evaluation of ACED: The impact of
feedback and adaptivity on learning. In Proceedings of the AIED 2007 (Artificial
Intelligence and Education) conference. Los Angeles, CA.
Almond, R. G. (2007). `I can name that Bayesian Network in Two Matrixes'. In Laskey, K. B.,
Mahoney, S. M., & Goldsmith, J. A. (Eds.), Proceedings of the 5th UAI Bayesian
Modeling Applications Workshop (pp. (online)). CEUR Workshop Proceedings.
Retrieved from
http://sunsite.informatik.rwth-aachen.de/Publications/CEUR-WS/Vol-268/paper1.pdf
Almond, R. G., Shute, V. J., Underwood, J. S., & Zapata-Rivera, Juan-Diego. (2006). Bayesian
Networks: A Teacher's View. In Proceedings of the 4th Bayesian Modeling Applications
Workshop. (Web): Utrecht University. Retrieved from
http://www.cs.uu.nl/groups/DSS/UAI-workshop/UAI-workshop06.html
Almond, R. G., DiBello, L., Jenkins, F., Mislevy, R. J., Senturk, D., Steinberg, L. S., & Yan, D.
(2001). Models for Conditional Probability Tables in Educational Assessment. In
Jaakkola, T., & Richardson, T. (Eds.), Artificial Intelligence and Statistics 2001 (pp.
137-143). Morgan Kaufmann.
Williamson, D. M., Mislevy, R. J., & Almond, R. G. (2000). Model criticism of Bayesian
networks with latent variables. In C. Boutilier, & M. Goldszmidt (Eds.), Uncertainty in
Artificial Intelligence 16 (pp. 634-643). Morgan Kaufmann.
Almond, R. G., Herskovits, E., Mislevy, R. J., & Steinberg, L. S. (1999). Transfer of information
between system and evidence models. In Heckerman, D., & Whittaker, J. (Eds.),
Artificial Intelligence and Statistics 99 (pp. 181-186). The Society for Artificial
Intelligence and Statistics.
Mislevy, R. J., Almond, R. G., Yan, D., & Steinberg, L. S. (1999). Bayes nets in educational
assessment: Where the numbers come from. In K. B. Laskey, & H. Prade (Eds.),
Uncertainty in Artificial Intelligence '99 (pp. 437-446). Morgan-Kaufmann.
Page 13
Vita for Russell George Almond
Page 13
Bradshaw, J. M., Chapman, C. R., Sullivan, K. M., Almond, R. G., Madigan, D., Zarley, D.,
Gavrin, J., Nims, J., & Bush, N. (1993). KS-3000: an application of DDUCKS to
transplant patient support. In Proceedings of the Sixth Annual Florida AI Research
Symposium (FLAIRS '93) (pp. 78-83). Florida AI Research Society. Retrieved from
http://pages.cpsc.ucalgary.ca/~gaines/BooseBradshaw/EKAW93KS-3000.doc
Almond, R. G. (1990). Breaking dependence in graphical belief models. In Page, Connie, &
LaPage, Raul (Eds.), Computing Science and Statistics: Proceedings of the 22nd
Symposium on the Interface (pp. 296-299). Springer-Verlag.
Almond, R. G. (1988). Fusion and propagation in graphical belief models. In Wegman, Edward
J., Gantz, Donald T., & Miller, John J. (Eds.), Computing Science and Statistics:
Proceedings of the 20th Symposium on the Interface (pp. 365-370). American Statistical
Association. Retrieved from http://ralmond.net/pubs/captain.pdf
Invited Reviews
Almond, R. G. (1999). Book Review. Statistics in Medicine, 18, 2983-4.
Nonrefereed Journal Articles
Almond, R. G., Kim, Y. J., Velasquez, G., & Shute, V. (2014). Rejoinder to Comments on Task
Features in Simulations and Games. Measurement: Interdisciplinary Research and
Perspectives, 12 (3), 118-124. doi:10.1080/15366367.2014.939528
Nonrefereed Summaries
van der Gaag, Linda, & Almond, R. (2009). Summary of Preface to Special Issue on Bayesian
Applications. International Journal of Approximate Reasoning, 50, 415.
Nonrefereed Reports
Steinberg, L. S., Almond, R. G., Baird, A. B., Cahallan, C., Chernick, H., DiBello, L. V.,
Kindfield, A. C. H., Mislevy, R. J., Senturk, D., & Yan, D. (2003). Introduction to the
Biomass Project: An Illustration of Evidence-Centered Assessment Design and Delivery
Capability (CSE Report 609). National Center for Research on Evaluation, Standards,
and Student Testing (CRESST). Retrieved from
http://www.cse.ucla.edu/reports/R609.pdf
Mislevy, R. J., Almond, R. G., DiBello, L., Jenkins, F., Steinberg, L. S., Yan, D., & Senturk, D.
(2002). Modeling conditional probabilities in complex educational assessments (CSE
Page 14
Vita for Russell George Almond
Page 14
Technical Report 580). The National Center for Research on Evaluation, Standards,
Student Testing (CRESST). Retrieved from http://www.cresst.org/reports/TR580.pdf
Mislevy, R. J., Steinberg, L. S., Breyer, F. J., Almond, R. G., & Johnson, L. (2001). Making
sense of data from complex assessments (CSE Technical Report 538). The National
Center for Research on Evaluation, Standards, Student Testing (CRESST). Retrieved
from http://www.cresst.org/reports/TECH538.pdf
Mislevy, R. J., Almond, R. G., & Steinberg, L. S. (1998). A note on knowledge-based model
construction in educational assessment (CSE Technical Report 480). The National
Center for Research on Evaluation, Standards, Student Testing (CRESST). Retrieved
from http://www.cresst.org/reports/TECH480.pdf
Almond, R. G. (1992). An approach to style in data analysis (Technical Report 225). University
of Washington, Department of Statistics. Retrieved from
http://ralmond.net/pubs/style.pdf
Almond, R. G., & Kong, C-T. A. (1991). Some heuristics for building an optimal tree of cliques
from a graph or hypergraph (Research Report 329). University of Chicago, Department
of Statistics. Retrieved from http://ralmond.net/pubs/akong.pdf
Almond, R. G. (1991). Fiducial inference and belief functions (Technical Report 206).
University of Washington, Department of Statistics. Retrieved from
http://ralmond.net/pubs/fisher.pdf
Presentations
Invited Papers at Conferences
Almond, R. G., Shute, V. J., Tingir, S., & Rahimi, S. (presented 2018, November). Identifying
observable outcomes in game-based assessments. Paper presented at The Eighteenth
Annual MARC Conference: Innovative Psychometric Modeling and Methods, Maryland
Assessment Research Center (MARC), College Park, MD. (International) Retrieved from
https://education.umd.edu/research/centers/marc/workshops-and-conferences/2018-marc-
conference
Almond, R. (presented 2014, April). Weighing Educational Evidence. Paper presented at 76th
Annual Meeting, National Council on Measurement in Education (NCME), Philadelphia,
PA. (International)
Almond, R. G. (presented 2008). Modeling diagnostic assessments with Bayesian networks.
Paper presented at Annual Meeting, Society for Mathematical Psychology, Washington,
D.C. (International)
Page 15
Vita for Russell George Almond
Page 15
Almond, R. G., Mislevy, R., & Steinberg, L. (presented 1998). A multivariate framework for
educational testing. Paper presented at Taipei International Statistics Symposium,
Chinese Statistical Association, Taipei Taiwan. (International)
Invited Papers at Symposia
Almond, R. G. (presented 2017, November). Measuring Flexibility and Systemic Thinking. In
Stanton Wortham and Henry Braun (Chair), Tracking Development Toward Living a Life
of Meaning and Purpose. Symposium conducted at the meeting of Boston College,
Boston, MA. (National) Retrieved from
https://www.spencer.org/tracking-development-toward-living-life-meaning-and-purpose-
addressing-challenges-measurement
Refereed Papers at Conferences
Almond, R., & Li, T. (presented 2014, April). Hierarchical Mixture Models for Pause Events
During Essay Writing. Paper presented at 76th Annual Meeting, National Council on
Measurement in Education (NCME), Philadelphia, PA. (National)
Kim, Y. J., Cui, M., & Almond, R. (presented 2014, April). Empirical Comparison of Bayesian
Networks and Structural Equation Models in the Context of Educational Assessment.
Paper presented at Annual Meeting, American Educational Research Association,
Philadelphia, PA. (National)
Wu, H., & Almond, R. (presented 2014, April). A Comparison of General Diagnostic Models
and Bayesian Networks. Paper presented at 76th Annual Meeting, National Council on
Measurement in Education (NCME), Philadelphia, PA. (National)
Kim, Y. J., Almond, R. G., Shute, V. J., & Ventura, M. (presented 2013). Constructing Bayesian
Networks for a Stealth Assessment of Qualitative Physics. Paper presented at Annual
Meeting, National Council on Measurement in Education (NCME), Philadelphia, PA.
(National)
Almond, R. G., & Shute, V. J. (presented 2009). Calibration of Bayesian network-based
diagnostic assessment. Paper presented at Annual Meeting, American Educational
Research Association (AERA), San Diego, CA. (National)
Almond, R. G., Mislevy, R. J., & Yan, D. (presented 2007). Using anchor sets to identify scale
and location of latent variables. Paper presented at Annual Meeting, National Council on
Measurement in Education (NCME), Chicago, IL. (National)
Page 16
Vita for Russell George Almond
Page 16
Almond, R. G. (presented 1997). Intelligent support of secondary data analysis. Paper presented
at Sixth International Workshop on AI and Statistics, Society for AI and Statistics, Fort
Lauderdale, FL. (International)
Refereed Papers at Symposia
Almond, R. G. (presented 2017, August). Tabular views of Bayesian networks. In John-Mark
Agosta and Tomas Singlair (Chair), Bayeisan Modeling Application Workshop 2017.
Symposium conducted at the meeting of Association for Uncertainty in Artificial
Intelligence, Sydney, Australia. (International) Retrieved from
http://bmaw2017.azurewebsites.net/
Almond, R. G., Tingir, S., Lu, X., Sun, C., & Rahimi, S. (presented 2017, August). A Validation
Tool for Conditional Probability Tables (CPT) for Physics Playground. In John-Mark
Agosta and Tomas Singlair (Chair), Bayeisan Modeling Application Workshop 2017.
Symposium conducted at the meeting of Association for Uncertainty in Artificial
Intelligence, Sydney, Australia. (International) Retrieved from
http://bmaw2017.azurewebsites.net/
Almond, R. G., & Mulder, J. (presented 2005). Models for local dependence among observable
outcome variables. In Third Annual Bayesian Application Workshop. Symposium
conducted at the meeting of Association for Uncertainty in Artificial Intelligence,
Edinburgh, Scotland. (International)
Yan, D., & Almond, R. G. (presented 2005). Using ROC curves to improve evidence for
diagnostic scoring. In Third Annual Bayesian Application Workshop. Symposium
conducted at the meeting of Association for Uncertainty in Artificial Intelligence,
Edinburgh, Scotland. (International)
Nonrefereed Papers at Symposia
Almond, R. G., Hemat, L., Zapata-Rivera, J., & Williamson, D. (presented 2004). Procrustean
method for reconciling expert opinion. In 2nd Bayesian Application Workshop.
Symposium conducted at the meeting of Association for Uncertainty in Artificial
Intelligence, Banff, Canada. (International)
Almond, R. G., Williamson, D. M., & Yan, D. (presented 2003). Testing Tests: Quality Control
for Assessment Design. In 1st Bayesian Application Workshop at Uncertainty in
Artificial Intelligence. Symposium conducted at the meeting of Association for
Uncertainty in Artificial Intelligence, Acapulco, Mexico. (International)
Mislevy, R., Steinberg, L., & Almond, R. G. (presented 1998). Evidence-centered assessment
design. In Annual Conference of the National Center for Research on Evaluation,
Standards, Student Testing (CRESST). Symposium conducted at the meeting of National
Page 17
Vita for Russell George Almond
Page 17
Center for Research on Evaluation, Standards, Student Testing (CRESST), Los Angeles,
CA. (National)
Invited Keynote and Plenary Presentations at Conferences
Almond, R. G. (presented 2015, April). How do we know when Technology and Instruction are
effective? Measuring Cognition and Learning. Keynote presentation at Annual Meeting
of the American Educational Research Association (AERA), Technology, Instruction,
Cognition and Learning special interest group, Chicago, IL. (International)
Almond, R. G. (presented 2015). Tips and tricks for building Bayesian networks for scoring
game-based assessments. Keynote presentation at The second Workshop on Advanced
Methodologies for Bayesian Networks, Japan Society of Artificial Intelligence,
Yokohama, Japan. (International)
Almond, R. G. (presented 2014, November). ECD for licensing: A participatory session. Plenary
presentation at Annual Meeting, Florida Educational Research Association, Cocoa Beech.
(State)
Almond, R. G. (presented 2001). Question and test interoperability in the new millennium.
Keynote presentation at International Meeting of the Psychometric Society, Psychometric
Society, Osaka, Japan. (International)
Smythe, C., & Almond, R. G. (presented 2001). The QTI framework for sharing assessment data
and results. Keynote presentation at International Meeting of the Psychometric Society,
Psychometric Society, Osaka, Japan. (International)
Invited Keynote and Plenary Presentations at Symposia
Almond, R. G. (presented 2008). Evidence-centered design as a tool for thinking about
assessment. Keynote presentation in B. J. Becker and V. J. Shute (Chair), Assessment for
the 21st Century: Insight. Symposium conducted at the meeting of College of Education,
Florida State University, Tallahassee, FL. (State)
Invited Presentations at Conferences
Almond, R. G. (presented 2012, June). Democratize ECD? Presentation at Games and Learning
Society Conference (gls 8.0), Games and Learning Society, Madison, WI. (National)
Almond, R. G., & Shute, V. J. (presented 2011). ACED: An example of using Bayesian networks
for cognitive diagnosis. Presentation at Annual Convention, Association for
Psychological Science (APS), Washington, D.C. (National)
Page 18
Vita for Russell George Almond
Page 18
Yan, D., Almond, R. G., Mislevy, R. J., & Williamson, D. M. (presented 2006). Bayesian
network applications. Presentation at Institute of Information Science, Academia Sinica,
Taipei, Taiwan. (International)
Invited Presentations at Symposia
Almond, R. G., Steinberg, L., & Mislevy, R. (presented 2001). The four process assessment
delivery architecture. In Cognition and Assessment: Theory to Practice. Presentation at
the meeting of University of Maryland, University of Maryland. (National)
Refereed Presentations at Conferences
Almond, R. G., Tingir, S., & Liu, Zhichun (Lukas). (accepted). Physics Playground scoring and
activity selection algorithms. Poster presentation to be given at AERA Annual Meeting,
American Educational Research Association. (National)
Rahimi, S., Almond, R. G., & Shute, V. J. (accepted). Technical Underpinnings of Physics
Playground. Poster presentation to be given at AERA Annual Meeting, American
Educational Research Association. (National)
Smith, G., Almond, R. G., Shute, V. J., Rahimi, S., & Ke, F. (accepted). Physics Playground
Demonstration. Poster presentation to be given at AERA Annual Meeting, American
Educational Research Association. (National)
Almond, R. G., Shute, V. J., Smith, G., Rahimi, S., Ke, F., Liu, Zhichun (Lukas), Lu, X., Sun,
C., Tingir, S., & Wiliams, D. (presented 2018, November). Physics Playground: A
Learning Game Demo with Posters. Presentation at Florida Educational Research
Association 63rd Annual Meeting, Florida Educational Research Association, St.
Petersburg, FL. (State) Retrieved from
https://feraonline.org/wp-content/uploads/2018/11/FERA-Program-2018_FINAL.pdf
Almond, R. G., Turner, J., Kim, Yoon-Jeon, & Hernandez, J. (presented 2018, October).
Evidence-centered classroom assessment design. Presentation at NCME Special
Conference on Classroom Assessment, National Council on Measurement in Education,
Lawrence, Kansas. (National) Retrieved from
https://aai.ku.edu/ncme-2018-special-conference
Almond, R. G. (presented 2016, November). An importance sampling algorithm for cognitive
diagnostic models using restricted regression. Presentation at Annual Meeting, Florida
Educational Research Association, Lakeland, FL. (State)
Page 19
Vita for Russell George Almond
Page 19
Almond, R. G. (presented 2016, February). Diagnostics for Learning Curve Analysis.
Presentation at Chapter Meeting, Florida Chapter of the American Statistical Association,
Tallahassee, FL. (Local)
Turner, J. E., Summers, J. J., Liu, S., & Almond, R. G. (presented 2015, April). Investigating
Students' Emotional Dynamics in Group-Work. Presentation at Annual Meeting,
American Educational Research Association, Chicago, IL. (National)
Almond, R. G., & Tokac, U. (presented 2014, November). Using Decision Theory to Allocate
Educational Resources. Presentation at Annual Meeting, Florida Educational Research
Association, Cocoa Beach, FL. (State)
Wu, H., & Almond, R. G. (presented 2013, April). The Comparison of the General Diagnostic
Model (GDM) and Bayesian Networks Using a Middle School Mathematics Test. Poster
presentation at Annual Meeting, American Educational Research Association, San
Francisco, CA. (National)
Kim, Y. J., Cui, M., & Almond, R. G. (presented 2013). Empirical Comparison of Bayesian
Networks and Structural Equation Models in the Context of Educational Assessment.
Poster presentation at Annual Meeting, American Educational Research Association
(AERA), Philadelphia, PA. (National)
Tokac, U., & Almond, R. G. (presented 2013). Early Prevention of Reading Difficulties by Using
Formative Assessment in Partially Observed Markov Decision Process. Poster
presentation at Annual Meeting of the American Educational Research Association,
American Educational Research Association, San Francisco, CA. (National)
Almond, R. G., Kim, Y. J., Velasquez, G., & Shute, V. J. (presented 2012, July). How Task
Features Impact Evidence from Assessments Embedded in Simulations and Games.
Presentation at International Meeting of the Psychometric Society (IMPS), Psychometric
Society, Lincoln, NE. (International)
Wu, H., & Almond, R. G. (presented 2012, July). An application of the general diagnostic model
(GDM) to a middle school mathematics test. Presentation at International Meeting of the
Psychometric Society (IMPS), Psychometric Society, Lincoln, NE. (International)
Wu, H., & Almond, R. G. (presented 2012). Comparing the general diagnostic model (GDM)
and Bayesian networks using a simulated diagnostic test. Poster presentation at Annual
Meeting of the AERA, American Educational Research Association, San Francisco, CA.
(National)
Almond, R. G. (presented 2011). Utilities and quasi-utilities for classification. Presentation at
Annual Meeting, National Committee on Measurement in Education (NCME), New
Orleans, LA. (National)
Page 20
Vita for Russell George Almond
Page 20
Almond, R. G., Deane, P., Quinlan, T. H., & Attali, Y. (presented 2011). Using timing logs to
diagnose problems in writing performance. Presentation at Annual Meeting, American
Educational Research Association (AERA), New Orleans, LA. (National)
Almond, R. G., & Lipnevich, A. (presented 2009). Value of evidence: A decision theoretic
approach to validity for diagnostic assessment. Presentation at Annual Meeting,
American Educational Research Association (AERA), San Diego, CA. (National)
Graf, E. A., Harris, K., Marquez, E., & Almond, R. G. (presented 2008). A cognitively based
assessment system for mathematics competency. Presentation at Annual Meeting,
American Educational Research Association (AERA), New York, NY. (National)
Shute, V. J., Hansen, E. G., & Almond, R. G. (presented 2007). Evaluation of ACED: The impact
of feedback and adaptivity on learning. Presentation at AIED 2007 (Artificial Intelligence
and Education) conference, Artificial Intelligence and Education, Los Angeles, CA.
(International)
Shute, V. J., Hansen, E. G., & Almond, R. G. (presented 2007). Towards Accessible test delivery
systems: A small-scale evaluation of a prototype system for improving the accessibility of
mathematics tests by individuals with visual disabilities. Presentation at Annual Meeting,
National Council on Measurement in Education (NCME), Chicago, IL. (National)
Almond, R. G. (presented 2006). Cognitive modeling to represent growth (learning) using
Markov decision processes. Presentation at Annual Meeting, American Educational
Research Association (AERA), San Francisco, CA. (National)
Ye, F., Almond, R. G., & Mislevy, R. J. (presented 2006). Diagnostic assessment of student
learning of patterns in 8th grade math classes: An evidence-centered design approach.
Presentation at Annual Meeting, National Council on Measurement in Education
(NCME), San Francisco, CA. (National)
Ye, F., Almond, R. G., Mislevy, R., & Yan, D. (presented 2004). Sensitivity to prior distributions
in calibration of a Bayesian network. Presentation at Annual Meeting, National Council
on Measurement in Education, San Diego, CA. (National)
Mislevy, R., Almond, R. G., & Steinberg, L. (presented 1999). Evidentiary considerations in
performance assessment. Presentation at Annual Meeting, National Council on
Measurement in Education. (National)
Refereed Presentations at Symposia
Almond, R. G. (presented 2018). Inner and Outer Q-matrixes for Multi-step problems. In Annual
Meeting. Presentation at the meeting of American Educational Research Association,
New York, NY. (National)
Page 21
Vita for Russell George Almond
Page 21
Nonrefereed Presentations at Conferences
Li, T., & Almond, R. G. (presented 2013, November). A Bayesian Hierarchical Mixture
Approach to Model Timing Data with Application to Writing Assessment. Presentation at
Annual Meeting, Florida Educational Research Association (FERA), Gainsville, FL.
(State)
Almond, R. G. (presented 2011). Challenges in MCMC, EM and Bayesian psychometrics.
Presentation at Annual Meeting, National Committee on Measurement in Education
(NCME), New Orleans, LA. (National)
Almond, R. G. (presented 2011). Measuring change in mental models. Presentation at Annual
Meeting, American Educational Research Association (AERA), New Orleans, LA.
(National)
Katz, I. R., Williamson, D. M., Nadelman, H. L., Kirsch, I., Almond, R. G., Cooper, P. L.,
Redman, M. L., & Zapata, D. (presented 2004, June). Assessing Information and
Communications Technology Literacy for Higher Education. Presentation at International
Association for Educational Assessment, International Association for Educational
Assessment, Philadelphia, PA. (International)
Breyer, F., Mislevy, R., Steinberg, L., & Almond, R. G. (presented 1999). Designing
technology-based assessments: It's the evidence for the inferences that are important.
Presentation at Annual Convention, Society for Industrial Organizational Psychology,
Atlanta, GA. (National)
Mislevy, R., Almond, R. G., & Steinberg, L. (presented 1997). Task design, student modeling,
and evidentiary reasoning in complex educational assessments. Presentation at Annual
Meeting, American Statistical Association, Anaheim, CA. (National)
Refereed Workshops
Kim, Y. J., Ventura, M., Shute, V. J., & Almond, R. G. (2012, June). Newton's Playground: How
to use evidence centered design (ECD) to develop game-based assessment. Workshop
delivered at Games and Learning Society Conference (gls 8.0), Madison, WI. (National)
Ventura, M., Kim, Y. J., Almond, R. G., & Wang, L. (2011). Using Crayon Physics Deluxe.
Workshop delivered at FCR-STEM Conference, Destin, Florida. (State)
Page 22
Vita for Russell George Almond
Page 22
Original Creative Works
Films
Almond, R. G., Huber, P., Kempthorne, P., & Roseman, L. (Director, Editor, Assistant
Producer). (accepted). Exploratory Multivariate Analysis: The crabs data [20 min
Documentary]. Harvard University, Department of Statistics.
Almond, R. G., Huber, P., Ramos, E., Roseman, L., & Thoma, M. (Director, Photographer,
Editor, Assistant Producer). (accepted). Visual aspects of 3d data graphics: A movie [10
min Documentary]. Harvard University, Department of Statistics.
Digital Projects
Refereed Digital Projects
IMS Global Consortium. (Named Contributor). (2000, January–2002, February). Question and
Test Interoperability Specification [XML Specification for Data Exchange]. IMS Global
Consortium. Retrieved from
http://www.imsglobal.org/question/qtiv1p2/imsqti_res_bestv1p2.html
Information and Communication Technology
Computer Software Development
Almond, R. G. (2018). Peanut/PNetica [Computer software]. self. Retrieved from
http://pluto.coe.fsu.edu/RNetica/Peanut.html
Almond, R. G. (2017). RNetica [Computer software]. (Author). Retrieved from
http://pluto.coe.fsu.edu/RNetica/RNetica.html
Almond, R. G. (2017). CPTtools [Computer software]. (Author). Retrieved from
http://pluto.coe.fsu.edu/RNetica/CPTtools.html
Almond, R. G. (2015). CPTtools [Computer software]. (Author). Retrieved from
http://pluto.coe.fsu.edu/RNetica/CPTtools.html
Almond, R. G. (2015). RNetica [Computer software]. (Author). Retrieved from
http://pluto.coe.fsu.edu/RNetica/RNetica.html
Almond, R. G. (2015). Peanut/PNetica [Computer software]. self. Retrieved from
http://pluto.coe.fsu.edu/RNetica/Peanut.html
Page 23
Vita for Russell George Almond
Page 23
Almond, R. G., Matukhin, A., & Yan, D. (2008). StatShop [Computer software]. Educational
Testing Service.
Shute, V. J., Hansen, E. H., Graf, E. A., Underwood, J., Almond, R. G., & Redman, M. (2007).
Adaptive Content with Evidence-based Diagnosis (ACED) [Computer software]. ETS.
Retrieved from http://ecd.ralmond.net/ecdwiki/ACED/ACED
Steinberg, L. S., Almond, R. G., Mislevy, R. J., Chernick, H., Kindfield, A., & Baird, A. (2001).
Biomass [Computer software]. Educational Testing Service.
Steinberg, L. S., Berenbach, B., Almond, R. G., Mislevy, R. J., & Chernick, H. (1998). Portal
[Computer software]. Educational Testing Service.
Almond, R. G. (1997). NAEPVUE [Computer software]. ETS.
Almond, R. G., & Tien, N. (1995). Graphical-Belief [Computer software]. MathSoft.
Almond, R. G. (1992). ElToY [Computer software]. Author. Retrieved from
http://lib.stat.cmu.edu/modules.php?op=modload&name=Downloads&file=index&req=g
etit&lid=263
Almond, R. G. (1990). BELIEF [Computer software]. Author. Retrieved from
http://www.cs.cmu.edu/afs/cs/project/ai-repository/ai/areas/reasonng/probabl/belief/0.htm
l
Patented Inventions
Steinberg, L. S., Mislevy, R. J., & Almond, R. G. (submitted). Portal Assessment design system
for educational testing. Educational Testing Service.
Almond, R. G., Steinberg, L. S., & Sinharay, S. (2014). Method and system for calibrating
evidence models. 11/170,649, Educational Testing Service.
Shute, V. J., Hansen, E. G., & Almond, R. G. (2010). Method and System for Designing adaptive
diagnostic assessments. 7,828,552, Educational Testing Service.
Contracts and Grants
Contracts and Grants Funded
Almond, Russell George (PI). (Jan 2018–Jul 2018). Psychometric Modeling Fellowship for
Gertrudes Velasquez. Funded by University of Kansas. Total award $7,000.
Page 24
Vita for Russell George Almond
Page 24
Erlebacher, Gordon (Co-PI), Clark, Kathleen (Co-PI), Shute, Valerie J (Co-PI), Ke, Fengfeng
(PI), & Almond, Russell George (Co-PI). (Aug 2017–Jul 2019). Mathematical Learning
via Architectural Design and Modeling Using E-Rebuild. Funded by National Science
Foundation. (1720533). Total award $971,310.
Shute, Valerie J (PI), Ke, Fengfeng (Co-PI), & Almond, Russell George (Co-PI). (Sep 2016–Aug
2019). DIP: Game-based Assessment and Support of STEM-related Competencies.
Funded by National Science Foundation. (1628937). Total award $1,066,257.
Becker, Betsy J (PI), & Almond, Russell George (Co-PI). (Apr 2016–Jun 2016). Proposal for
Existing Item Pool Validation for the Florida Department of Highway Safety and Motor
Vehicles. Funded by Florida Department of Highway Safety and Motor Vehicles.
(AEC69E). Total award $20,939.
Almond, Russell George (PI). (Mar 2013–Aug 2014). Ubiquitous Assessment Using Data From
Perason's Mathxl. Funded by Pearson, Inc. Total award $50,000.
Contracts and Grants Denied
Turner, Jeannine E (Co-PI), Mon, Lorraine M (Co-PI), Ke, Fengfeng (Co-PI), Almond, Russell
George (PI), & He, Zhe (Co-PI). (Jun 2018). RTG: The Datasmith Workshop. Submitted
to National Science Foundation.
Almond, Russell George (PI). (Jul 2016). A Bayesian Basis To Support Teacher Decision
Making: Baysys. Submitted to University of Oregon.
Nese, J., & Almond, R. G. (Jul 2014). Bayesian System as Basis for Teacher Decision Making:
BaySys. Submitted to Institute of Educational Statistics.
Reviews of My Research and Original Creative Work by Other Authors
Reviews Appearing in Journals
van Buuren, N., de Klerk, S., & Veldkamp, B. P. (2017). ALMOND, R. G., MISLEVY, R. J.,
STEINBERG, L. S., YAN, D., & WILLIAMSON, D. M (2015). Bayesian Networks in
Educational Assessment. NY: Springer. ISBN: 1493921258. Psychometrika, 82,
1182--1184. Retrieved from https://link.springer.com/article/10.1007/s11336-017-9585-6
Working Papers
Almond, R. G. (2018). Rules of Evidence for Parsing Event Logs. self
(https://pluto.coe.fsu.edu/Proc4).
Page 25
Vita for Russell George Almond
Page 25
Service
Florida State University
FSU University Service
Chair, Teaching and Evaluation Committee (2016–2017).
Member, Teaching and Evaluation Committee (2011–2017).
FSU College Service
Member, College Curriculum Committee (2016–2018).
Member, Technology Commmittee (2015–2016).
Alternate Member, Technology Committee (2012).
FSU Department Service
Chair, Curriculum Committee (2016–2018).
Chair, Bylaws Committee (2010–2018).
Member, Curriculum Committee (2014–2016).
Member, Evaluation Committee (2012–2014).
FSU Program Service
Chair, Admissions Committee (2015–present).
Coordinator, Colloquium Committee (2011–present).
Interim Coordinator, Program Coordinator (2014).
Page 26
Vita for Russell George Almond
Page 26
The Profession
Guest Editing for Refereed Journals
van der Gaag, L., & Almond, R. G. (Eds.). (2009, January). Special Issue on Bayesian
applications [Special Issue]. International Journal of Approximate Reasoning, 50.
Editorial Board Membership(s)
Behaviormetrika (2017–present).
Artificial Intelligence in Education Conference (2015–present).
Technology, Instruction, Cognition and Learning (2013–present).
Uncertainty in Artificial Intelligence (UAI) [Conference Program Committee] (1999–present).
Association for Computing Machinary Learning@Scale Conference (2013).
Artificial Intelligence and Statistics [Program Committee Membership] (1997–2001).
Reviewer for Textbooks
Fundamentals of Statistical Reasoning in Education (2012).
Chair of a Symposium
Laskey, K. B., Jones, J. H. R., & Almond, R. G. (Chair). (2014, July). Eleventh UAI Bayesian
Modeling Applications Workshop. Symposium conducted at the meeting of Association
for Uncertainty in Artificial Intelligence, Quebec, Canada.
Almond, R. G., & Mengshoel, O. (Chair). (2013, July). 2013 UAI Application Workshops: Big
Data meet Complex Models and Models for Spatial, Temporal and Network Data.
Symposium conducted at the meeting of Association for Uncertainty in Artificial
Intelligence, Seattle, WA.
van der Gaag, L., & Almond, R. G. (Chair). (2006). 4th Annual Applications Workshop at
Uncertainty in Artificial Intelligence conference. Symposium conducted at the meeting of
Association for Uncertainty in Artificial Intelligence.
Page 27
Vita for Russell George Almond
Page 27
Almond, R. G. (Chair). (2005). 3rd Annual Applications Workshop at Uncertainty in Artificial
Intelligence Conference. Symposium conducted at the meeting of Association for
Uncertainty in Artificial Intelligence, Edinburgh, Scotland.
Reviewer or Panelist for Grant Applications
Institute of Educational Statistics (2009–2011).
Service to Professional Associations
Member: Question and Test Interoperability Working Group, Developed specifications for
Question and Test Interoperability, IMS Consortium (1999–2001).
The Community
Volunteer Mentor, Served as mentor for high school student doing science project, Mentor
Power, NJ (2005–2010).
Member, Board of Directors, Mentor Power, NJ (2006–2007).
Consultation
Educational Testing Service. Consultation on designing open-source tools for Evidence-centered
Assessment Design (2018–present).
Dynamic Learning Maps Consortium. Technical Advisory Committee for project for developing
alternative assessments for students with special needs (2015–present).
WestEd. Technical Advisory Panel for SimScientist, Voyage to Galopogas and other
development grants for science education products (2011–present).
Behavioral Research and Technology. Data analysis on response to intervention data
(2015–2017).
Educational Testing Service. Working on models for pause times in reading (2012–2014).