1. R. Cavazos-Cadena and E. Fernández-Gaucherand, "Risk-Sensitive Control in Communicating Average Markov Decision Chains," in Modeling Uncertainty: an examination of stochastic theory, methods, and applications. M Dror, P L'Ecuyer, F. Szidarovzky, Eds., Kluwer Academic, (2002) pp. 515-553.
(PDF File)   

2. S.I. Marcus, E. Fernández-Gaucherand, D. Hernández-Hernández, S. Coraluppi and P. Fard, "Risk Sensitive Markov Decision Processes," in Systems & Control in the Twenty-First Century. Series: Progress in Systems and Control, Birkhäuser. Editors: C.I. Byrnes, B.N. Datta, D.S. Gilliam, C.F. Martin, (1996) pp. 263-279.

3. E. Fernández-Gaucherand, A. Arapostathis, and S.I. Marcus, "Adaptive Control of Partially Observed Controlled Markov Chains," Stochastic Theory and Adaptive Control, T.E. Duncan, B. Pasik-Duncan, Eds., Springer-Verlag, (1992) 161-171.

4. E. Fernández-Gaucherand, S.I. Marcus, and A. Arapostathis, "Structured Solutions for Stochastic Control Problems," Stochastic Theory and Adaptive Control, T.E. Duncan, B. Pasik-Duncan, Eds., Springer-Verlag, (1992) 172-184.

5. E. Fernández-Gaucherand, M.K. Ghosh and S.I. Marcus, "Markov Decision Processes on the Infinite Planning Horizon with a Weighted Cost Criterion," in Contribuciones en Probabilidad y Estadística Matemáatica, N. 3, (1992) 145-162.

6. E. Fernández-Gaucherand, A. Arapostathis and S.I. Marcus, “On the Adaptive Control of a Partially Observable Binary Markov Decision Process," in Advances in Communications and Control Systems, W.A. Porter and S.C. Kak, Eds., Springer-Verlag, (1989) 217-228.




1. E. Fernández-Gaucherand, A. Arapostathis and S.I. Marcus, "Remarks on the Existence of Solutions to the Average Cost Optimality Equation in Markov Decision Processes," Systems and Control Letters, 15 (1990) 425-432.
(PDF File)   

2. E. Fernández-Gaucherand, A. Arapostathis and S.I. Marcus, "On the Average Cost Optimality Equation and the Structure of Optimal Policies for Partially Observable Markov Decision Processes," Annals of Operations Research 29 (1991)
(PDF File)   

3. A. Arapostathis, V.S. Borkar, E. Fernández-Gaucherand, M.K. Ghosh, and S.I.Marcus, "Discrete-Time Controlled Markov Processes with Average Cost Criterion: A Survey," SIAM Journal on Control and Optimization 31 (1993) 282-344.
(PDF File)  

4. E. Fernández-Gaucherand, A. Arapostathis and S.I. Marcus, "Analysis of an Adaptive Control Scheme for a Partially Observed Controlled Markov Chain," IEEE Transactions on Automatic Control 38 (1993) 987-993. 
(PDF File)  

5. E. Fernández-Gaucherand, M.K. Ghosh and S.I. Marcus, "Controlled Markov Processes on the Infinite Planning Horizon: Weighted and Overtaking Cost Criteria," ZOR: Mathematical Methods of Operations Research 39 (1994) 131-155. 
(PDF File)

6. E. Fernández-Gaucherand, "A Note on the Ross-Taylor Theorem," Applied Mathematics & Computation 64 (1994) 207-212.
(PDF File)

 
7. R. Cavazos-Cadena and E. Fernández-Gaucherand, "Denumerable Controlled Markov Chains with Average Reward Criterion: Sample Path Optimality," ZOR: Mathematical Methods of Operations Research 41 (1995) 89-108. 
(PDF File)

8. E. Fernández-Gaucherand, S. Jain, H.L. Lee, A.G. Rao and M.R. Rao, "Improving Productivity by Periodic Performance Evaluation: A Bayesian Stochastic Model," Management Science 41 (1995) 1669-1678. 
(PDF File) 

9. R. Milito and E. Fernández-Gaucherand, "Open-Loop Routing of N Arrivals to M Parallel Queues," IEEE Transactions on Automatic Control 40 (1995) 2108-2114.
(PDF File)  

10. R. Cavazos-Cadena and E. Fernández-Gaucherand, "Denumerable Controlled Markov Chains with Strong Average Optimality Criterion: Bounded & Unbounded Costs," ZOR: Mathematical Methods of Operations Research 43 (1996) 281-300. 
(PDF File) 

11. R. Cavazos-Cadena and E. Fernández-Gaucherand, "Value Iteration in a Class of Average Controlled Markov Chains with Unbounded Costs: Necessary and Suficient Conditions for Pointwise Convergence," Journal of Applied Probability 33 (1996) 986-1002.
(PDF File) 

12. M.L. McGinnis, E. Fernández-Gaucherand and P.B. Mirchandani, "Scheduling Training Resources for the United States Army: System Model, Optimal & Heuristic Decision Processes", Military Operations Research Journal 2 (1996) 53-69. (Winner of the 1995 David Rist Prize, Military Operations Research Society).
(PDF File)   

13. E. Fernández-Gaucherand, "Non-Standard Optimality Criteria for Controlled Markov Processes," ZAMM: Zeitschrift für Angewandte Mathematik und Mechanik, Special issue on Applied Stochastics and Optimization, (1996) 423-424. 
(PDF File) 

14. S. Moskowitz, E. Fernández-Gaucherand and M. Whalen, "Passage-Detector-Based Traffic Queue Estimation in Intelligent Transportation Systems: A Computational Study of Competing Algorithms". Applied Mathematics & Computation 86 (1997) 93-113. 
(PDF File)

15. E. Fernández-Gaucherand and S.I. Marcus, "Risk-Sensitive Optimal Control of Hidden Markov Models: Structural Results." IEEE Transactions on Automatic Control 42 (1997) 1418-1422.
(PDF File)  

16. A. Galambosi, E.C. Ozelkan, E. Fernández-Gaucherand and L. Duckstein, "Water Reservoir Management Using Linear Quadratic Dynamic Programming. Applied Mathematical Modelling 21 (1997) 591-598. 
(PDF File)

17. R. Cavazos-Cadena and E. Fernández-Gaucherand, "Controlled Markov Chains with Risk Sensitive Criteria: Average Cost, Optimality Equations, and Optimal Solutions," in Mathematical Methods of Operations Research 49 (1999) 299-324. 
(PDF File)

18. R. Cavazos-Cadena and E. Fernández-Gaucherand, "The Vanishing Discount Approach in a Stable Markov Reward Process with a Risk-Sensitive Average Cost Criterion." IEEE Transactions on Automatic Control 45 (2000) 1800-1816. 
(PS File) (PDF File)

19.M.A. Shayman and E. Fernández-Gaucherand, "Risk Sensitive Decision Theoretic Diagnosis". IEEE Transactions on Automatic Control, , Volume: 46 Issue: 7 , July 2001, 1166 -1171
(PDF File)

20. R. Cavazos-Cadena and E. Fernández-Gaucherand, "Markov Decision Processes with Risk Sensitive Average Cost Criterion: Necessary Conditions for Optimal Solutions." Submitted for publication. 

21.R. Cavazos-Cadena and E. Fernández-Gaucherand, "Risk Sensitive Optimal Control in Communicating Average Markov Decision Chains." Submitted for publication.

22. Matthew Flint , Marios Polycarpou, Emmanuel Fernandez, "Stochastic Models of a Cooperative Autonomous UAV Search Problem", Military Operations Research Journal, vol. 8, no. 4, (1996) 13-32.
(PDF File)   

23. J. A. Ramírez-Hernández and E. Fernandez, M. O'Connor, and N. Patel, Conversion of Non-Calendar to Calendar-Time Based Preventive Maintenance Schedules for Semiconductor Manufacturing Systems, Journal of Quality in Maintenance Engineering, vol. 13, no. 3, pp. 259-275, 2007.
(PDF File)   






1. E. Fernández-Gaucherand and J.Y. Cheung, "A Suboptimal Solution to IIR Adaptive Filtering Using an Extended LMS Algorithm," in Proc. 22nd Annual Allerton Conference on Communication, Control, and Computing, (1984) 132-141. 
(PDF File)

2. E. Fernández-Gaucherand and J.R. Cruz, "Equalization of Transmission Line Channels: A Discussion of Three IIR Adaptive Filtering Algorithms," in Proc. IEEE Int'l Conference on Acoustics, Speech, and Signal Processing, Tampa, FL, (1985) 1249-1252. 
(PDF File)

3. E. Fernández-Gaucherand and J.Y. Cheung, "A Comparison of the Equation Error and Output Error Approaches in Adaptive IIR Filtering," in Proc. 29th Midwest Symposium on Circuits and Systems, M. Ismail, Ed., North-Holland, (1986) 63-66. 
(PDF File)

4. E. Fernández-Gaucherand and J.Y. Cheung, "Block Implementation of IIR Adaptive Filters Via the Equation Error Approach," in Proc. 29th Midwest Symposium on Circuits and Systems, M. Ismail, Ed., North-Holland, (1986) 547-550. 
(PDF File)

5. E. Fernández-Gaucherand, A. Arapostathis and S. I. Marcus, "On the Adaptive Control of Partially Observable Markov Decision Processes," Proc. 27th IEEE Conf. Decision and Control, Austin, TX, (1988) 1204-1210. 
(PDF File)

6. E. Fernández-Gaucherand, A. Arapostathis and S. I. Marcus, "On Partially Observable Markov Decision Processes with an Average Cost Criterion," Proc. 28th IEEE Conference on Decision and Control, Tampa, Florida, (1989) 1267-1272, vol.2. 
(PDF File)

7. A. Arapostathis, E. Fernández-Gaucherand and S. I. Marcus, "Analysis of an Adaptive Control Scheme for a Partially Observed Controlled Markov Chain," in Proc. 29th IEEE Conference on Decision and Control, Honolulu, Hawaii, (1990) 1438-1444. 
(PDF File)

8. S.I Marcus, E. Fernández-Gaucherand and A. Arapostathis, "Adaptive Control and Cost Sensitivity of Stochastic Systems with Continuous State and Parameters, and Logical Controls," in Proc. 1991 American Control Conference, Boston, MA, (1991) 26-28. 


9. E. Fernández-Gaucherand, A. Arapostathis and S. I. Marcus, "A Methodology for the Adaptive Control of Markov Chains Under Partial State Information," in Proc. 1992 Conference on Information Sciences and Systems, Princeton University, (1992) 773-775. 


10. E. Fernández-Gaucherand, A. Arapostathis and S. I. Marcus, "Convex Stochastic Control Problems," in Proc. 31st IEEE Conference on Decision and Control, Tucson, AZ, (1992) 2179-2180. 
(PDF File)


11. E. Fernández-Gaucherand, A. Arapostathis and S. I. Marcus, "A Methodology for the Adaptive Control of Markov Chains Under Partial State Information," in Proc. 31st IEEE Conference on Decision and Control, Tucson, AZ, (1992) 2750-2751. 
(PDF File)


12. E. Fernández-Gaucherand, M.K. Ghosh and S.I. Marcus, "Controlled Markov Processes on the Infnite Planning Horizon: Weighted and Overtaking Cost Criteria," in Proc. 32nd IEEE Conference on Decision and Control, San Antonio, TX, (1993) 381-386.
(PDF File)


13. Fernández-Gaucherand, E.; Sanjay Jain; Lee, H.L.; Rao, A.G.; Rao, M.R., "Optimal evaluation policies for workforce: a Bayesian stochastic model", Proceedings of the 32nd IEEE Conference on Decision and Control, 1993, San Antonio, TX, 391 -392, vol.1.
(PDF File)


14. E. Fernández-Gaucherand, J. Choi, and D. Gerhart, "S^2 YSCODE: Stochastic Systems Control & Decision Algorithms Software Laboratory: FORTRAN & MATLAB Versions," in Proc. 1994 IEEE/IFAC Joint Symposium on Computer-Aided Control Systems Design, Tucson, AZ, (1994) 179-186.
(PDF File)  


15. M.L. McGinnis and E. Fernández-Gaucherand, "Resource Scheduling for the United States Army's Basic Combat Training Program," in Proc. 1994 IEEE Int'l Conference on Systems, Man, and Cybernetics, San Antonio, TX, (1994) 553-558.
(PDF File)    

16. M.V. González, E. Fernández-Gaucherand, and D. Baker, "A Descriptive Study of College Minority and Majority Student's Attitudes Toward Engineering Courses and Peer Study Groups," in Proc. Frontiers in Education 1994 Conference: Educating Engineers for World Competition, San Jose, CA, (1994) 424-429. 
(PDF File)    

17. M.E. Kurz and E. Fernández-Gaucherand, "MIST: A MATLAB Introductory Statistical Toolbox," in Proc. Frontiers in Education 1994 Conference: Educating Engineers for World Competition, San Jose, CA, (1994) 397-404. 
(PDF File)  


18. R.A. Milito and E. Fernández-Gaucherand, "Open-Loop Routing of N Arrivals to M Parallel Queues," in Proc. 33rd IEEE Conference on Decision and Control, Orlando, FL, (1994) 184-189. 
(PDF File)    

19. R. Cavazos-Cadena and E. Fernández-Gaucherand, "Denumerable Controlled Markov Chains with Strong Average Optimality Criterion: Bounded & Unbonded Costs," in Proc. 33rd IEEE Conference on Decision and Control, Orlando, FL, (1994) 1456-1461. 
(PDF File)    

20. R. Cavazos-Cadena and E. Fernández-Gaucherand, "Denumerable Controlled Markov Chains with Average Reward: Sample Path Optimality," in Proc. 33rd IEEE Conference on Decision and Control, Orlando, FL, (1994) 162-167. 
(PDF File)   

21. J. Choi, E. Fernández-Gaucherand, and D. Gerhart, "SYSCODE: A Software Laboratory for Stochastic Systems Control & Decision Algorithms: FORTRAN & MATLAB Versions," in Proc. 33rd IEEE Conference on Decision and Control, Orlando, FL, (1994) 2528-2533. 
(PDF File)  

22. M.L. McGinnis and E. Fernández-Gaucherand, "A Dynamic Programming Model for the Initial Entry Training Program of the United States Army," in Proc. 33rd IEEE Conference on Decision and Control, Orlando, FL, (1994) 3632-3633. 
(PDF File)  

23. E. Fernández-Gaucherand and S.I. Marcus, "Risk-Sensitive Optimal Control of Hidden Markov Models: A Case Study," in Proc. 33rd IEEE Conference on Decision and Control, Orlando, FL, (1994) 1657-1662.
(PDF File)      

24. R. Cavazos-Cadena and E. Fernández-Gaucherand, "Value Iteration in a Class of Controlled Markov Chains with Average Criterion: Unbounded Cost Case," in Proc. 34th IEEE Conference on Decision and Control, New Orleans, LA, (1995) 2283-2288. 
(PDF File)

25. R.A. Milito and E. Fernández-Gaucherand, "Routing Arrivals to M Queues in Parallel," in Proc. 34th IEEE Conference on Decision and Control, New Orleans, LA, (1995) 1415-1420. 
(PDF File)

26. E. Fernández-Gaucherand and S.I. Marcus, "Non-Standard Optimality Criteria for Stochastic Control Problems," in Proc. 34th IEEE Conference on Decision and Control, New Orleans, LA, (1995) 585-589. 
(PDF File)

27. G.M. Avila-Godoy, A. Brau and E. Fernández-Gaucherand, "Controlled Markov Chains with Discounted Risk-Sensitive Criteria: Applications to Machine Replacement," in Proc. 36th IEEE Conference on Decision and Control, San Diego, CA, (1997) 1115-1120.
(PDF File)

28. A. Brau and E. Fernández-Gaucherand, "Controlled Markov Chains with Risk Sensitive Exponential Average Cost Criterion," in Proc. 36th IEEE Conference on Decision and Control, San Diego, CA, (1997) 2260-2264. 
(PDF File)

29. G.M. Avila-Godoy and E. Fernández-Gaucherand, "Exponential Risk-Sensitive Optimal Scheduling," in Proc. 36th IEEE Conference on Decision and Control, San Diego, CA, (1997) 3958-3963. 
(PDF File)

30. A. Brau, R. Cavazos-Cadena and E. Fernández-Gaucherand, "Controlled Markov Chains with Risk-Sensitive Criteria: Some (Counter) Examples," in Proc. 37th IEEE Conference on Decision and Control, Tampa, FL, (1998) 1853-1858. 
(PDF File)

31. G.M. Avila-Godoy and E. Fernández-Gaucherand, "Controlled Markov Chains with Exponential Risk-Sensitive Criteria: Modularity, Structured Policies and Applications," in Proc. 37th IEEE Conference on Decision and Control, Tampa, FL, (1998) 778-783. 
(PDF File)

32. M.A. Shayman and E. Fernández-Gaucherand, "Risk sensitive decision theoretic troubleshooting,", In Proc. 37th Annual Allerton Conference on Communication, Control, and Computing, September 22-24, 1999. 
(PDF File)

33. R. Cavazos-Cadena and E. Fernández-Gaucherand, "Recent results in controlled Markov chains with risk sensitive average criteria: the vanishing discount approach ," in Proc. 38th IEEE Conference on Decision and Control, Phoenix, AZ, December, 1999, 121 -125 vol.1
(PDF File)  

34. S. Bhatnagar, E. Fernández-Gaucherand, M.C. Fu, Y. He, and S.I. Marcus, "A Markov Decision Process Model for Capacity Expansion and Allocation", in Proc. 38th IEEE Conference on Decision and Control, Phoenix, AZ, December, 1999.
(PS File) (PDF File)  



35. G.M. Avila-Godoy and E. Fernández-Gaucherand, "Risk-Sensitive Inventory Control Problems," in Proc. Industrial Engineering Research Conference 2000, Cleveland, OH, May 2000.
  (PS File)

36. M.A. Shayman and E. Fernández-Gaucherand, "Fault management in communication networks: test scheduling with a risk-sensitive criterion and precedence constraints", Proceedings of the 39th IEEE Conference on Decision and Control, Sidney, Australia, December 2000, 1864-1869.
(PDF File)  

37. G.M. Avila-Godoy and E. Fernández-Gaucherand, "Risk Mitigation in Supply Chain Inventory Management," Invited paper submitted to 39th IEEE Conference on Decision and Control, Sidney, Australia, December 2000.



38. Xiaodong Yao; Fu, M.; Marcus, S.I.; Fernandez-Gaucherand, E. "Optimization of preventive maintenance scheduling for semiconductor manufacturing systems: models and implementation", Proceedings of the 2001 IEEE International Conference on Control Applications, Mexico City, Mexico, 200, 407 -411.
(PDF File)  

39. Agustin Brau-Rojas, Emmanuel Fernandez-Gaucherand, "Controlled Markov Chains with Risk-Sensitive Average Cost Criterion: The Non-Irreducible Case", Proceedings of the 40th IEEE Conference on Decision and Control, Orlando, Florida USA, December 2001, 2108-2109.
(PDF File)



40. Guadalupe M. Avila-Godoy, Emmanuel Fernandez-Gaucherand, "Risk-Sensitive Inventory Control Problems", Proceedings of the 40th IEEE Conference on Decision and Control, Orlando, Florida USA, December 2001, 4577.
(PDF File)

41. Rolando Cavazos-Cadena, Emmanuel Fernandez-Gaucherand, "Markov Decision Processes with Risk-Sensitive Criteria: Dynamic Programming Operators and Discounted Stochastic Games", Proceedings of the 40th IEEE Conference on Decision and Control, Orlando, Florida USA, December 2001, 2110-2112.
(PDF File)

42. Xiaodong Yao, Michael Fu, Steven Marcus, Emmanuel Fernandez. “Incorporating Production Planning into Preventive Maintenance Scheduling in Semiconductor Fabs", MASM 2002 Conference, Tempe, AZ, 2001, 84-89 .
(Paper, PDF)

43. Matthew Flint, Marios Polycarpou, Emmanuel Fernandez-Gaucherand, "Cooperative Path-Planning For Autonomous Vehicles Using Dynamic Programming", IFAC 15th Triennial World Congress, Barcelona, Spain, (2002) 1694-1699.
(PDF File)

44. Matthew Flint , Marios Polycarpou, Emmanuel Fernandez-Gaucherand, "Cooperative Control for Multiple Autonomous UAV’s Searching for Targets", Proceedings of the 41st IEEE Conference on Decision and Control, Volume: 3, 10-13 Dec. 2002, pp. 2823 - 2828.
(PDF File)

45. Rizvi, B., Fernandez-Gaucherand, E., "Analysis of adjusted probabilistic packet marking" , IP Operations and Management, 2003. (IPOM 2003). 3rd IEEE Workshop on , Oct. 1-3, 2003, pp. 9 - 13.
(PDF File)

46. Matthew Flint ,Emmanuel Fernandez-Gaucherand, Marios Polycarpou, "Cooperative Control for UAV’s Searching Risky Environments for Targets", in Proceedings of the 42nd IEEE Conference on Decision and Control, Maui, HI, 8-12 Dec. 2003, pp. 2823 - 2828.
(PDF File)

47. Ramírez-Hernández, J., and Fernández-Gaucherand, E., “An Algorithm to Convert Wafer to Calendar-Based Preventive Maintenance Schedules for Semiconductor Manufacturing Systems”, in Proceedings of the 42nd IEEE Conference on Decision and Control, Maui, HI, 8-12 Dec. 2003, pp. 5926-5931.
(PDF File)

48. M. Flint, E. Fernandez-Gaucherand, and M. Polycarpou. "Efficient Bayesian Methods for Updating and Storing Uncertain Search Information for UAV’s". In Proc. of the 43nd IEEE Conference on Decision and Control, (to appear), 2004.
(PDF File)

49. M. Flint, E. Fernandez-Gaucherand, and M. Polycarpou. "A probabilistic framework for passive cooperation among UAV’s performing a search". In Proc. of the Sixteenth International Symposium on Mathematical Theory of Networks and Systems (MTNS2004), 2004.
(PDF File)


50. Ramírez-Hernández, J. A.; Li, H.;Fernández-Gaucherand, E.; McLean, C. R.; and Leong, S., A Framework for standard modular simulation in semiconductor wafer fabrication systems, in Proceedings of the 2005 Winter Simulation Conference, Orlando, FL, December 2005, pp. 2162-2171.
(PDF File)

51. Ramírez-Hernández, J., and Fernández, E., A Case Study in Scheduling Reentrant Manufacturing Lines: Optimal and Simulation-Based Approaches, in Proceedings of the 44th IEEE Conference on Decision and Control, Seville, Spain, December 12-15, 2005, pp. 2158-2163.
(PDF File)


52. Ramírez-Hernández, J., and Fernández, E., Optimal Job Sequencing in a Benchmark Reentrant Line with Finite Capacity Buffers, in Proceedings of the 17th International Symposium on Mathematical Theory of Networks and Systems 2006, Kyoto, Japan, 2005, pp. 1214-1219.
(PDF File)


53. Ramírez-Hernández, J., and Fernández, E.,Optimal job releasing and sequencing for a reentrant manufacturing line with finite capacity buffers, in Proceedings of the 45th IEEE Conference on Decision and Control, San Diego, CA, December 13-15, 2006, pp. 6654-6659.
(PDF File)


54.Ramírez-Hernández, J., and Fernández, E., An approximate dynamic programming approach for job releasing and sequencing in a reentrant manufacturing line, in Proceedings of the 2007 IEEE Symposium on Approximate Dynamic Programming and Reinforcement Learning (ADPRL 2007), Honolulu, HI, April 2007, pp. 201-208.
(PDF File)


55. Ramírez-Hernández, J., and Fernández, E., Control of a Re-entrant Line Manufacturing Model with a Reinforcement Learning Approach, in Proceedings of The Sixth International Conference on Machine Learning and Applications (ICMLA’07), Cincinnati, Ohio, December 13-15, 2007, pp. 330-335.
(PDF File)