---

• Xin Xu, Reinforcement Learning and Approximate Dynamic Programming, Science Press, 2010, Beijing, China

• Xin Xu, Machine Learning for Sequential Behavior Modeling and Prediction, In: Abdelhamid Mellouk and Abdennacer Chebira,ed. Machine Learning, 2009, I-Tech, Vienna, Austria

• Xin Xu, Reinforcement learning and neuro-dynamic programming, In: Dewen Hu, et al., ed. Neural Networks for Adaptive Control, Press of NUDT, 2007, Changsha, China

---

• Xin Xu, Dewen Hu, Xicheng Lu. Kernel-based least squares policy iteration for reinforcement learning. IEEE Transactions on Neural Networks, 2007, 18(4) 973-992   (Google scholar, cited 58 times)

• Xin Xu, Chunming Liu, Simon Yang, Dewen Hu. Hierarchial Approximate Policy Iteration with Binary-tree State Space Decomposition, IEEE Transactions on Neural Networks, 2011, 22(12): 1863-1877

• Xin Xu. Sequential Anomaly Detection Based on Temporal-Difference Learning: Principles, Models and Case Studies. Applied Soft Computing, 2010, 10(3): 859-867.

• Xin Xu, Chunming Liu, Dewen Hu. Continuous-Action Reinforcement Learning with Fast Policy Search and Adaptive Basis Function Selection. Soft Computing, 2011, 15(6): 1055-1070.

• Xin Xu, H.G. He, D.W. Hu. Efficient reinforcement learning using recursive least-squares methods. Journal of Artificial Intelligence Research, 2002,16: 259-292   (Google scholar, cited 65 times)

• Xin Xu, Zhongsheng Hou, Chuanqiang Lian and Haibo He. Online Learning Control Using Adaptive Critic Designs with Sparse Kernel Machines, submitted to IEEE Transactions on Neural Networks, under review.

• Xin Xu, Rob Law, Tao Wu. Support Vector Machines with Manifold Learning and Probabilistic Space Projection for Tourist Expenditure Analysis. International Journal of Computational Intelligence Systems, 2009, 2(1): 17 - 26

• Xin Xu, et al. Kernel Least-Squares Temporal Difference Learning. International Journal of Information Technology, Institute of Singapore (ICIS), 2005, 11(9): 54-63

• Xin Xu. Adaptive Intrusion Detection Based on Machine Learning: Feature Extraction, Classifier Construction and Sequential Pattern Prediction. International Journal of Web Service Practice, 2006, 2(1-2):49-58

• Xin Xu. Intrusion detection based on dynamic behavior modeling: reinforcement learning versus Hidden Markov Models. International Journal of Computational Intelligence Theory and Practice, 2007, 2(1): 57-66

• Haibo He, Sheng Chen, Kang Li, and Xin Xu. Incremental learning from stream data. IEEE Transactions on Neural Networks, 2011, 22(12): 1901-1914.

• Junping Zhang, Feiyue Wang, Kungfeng Wang, Weihua Lin, Xin Xu, Cheng Chen. Data-Driven Intelligent Transportation Systems: A Survey.  IEEE Transactions on Intelligent Transportation Systems, 2011, 12(4): 1624-1639.

• Shiliang Sun, Xin Xu. Variational Inference for Infinite Mixtures of Gaussian Processes with Applications to Traffic Flow Prediction. IEEE Transactions on Intelligent Transportation Systems,2011, 12(2): 466-475.

• Zhongsheng Hou, Xin Xu, Jingwen Yan, Jian-Xin Xu, Gang Xiong: A Complementary Modularized Ramp Metering Approach Based on Iterative Learning Control and ALINEA. IEEE Transactions on Intelligent Transportation Systems, 2011, 12(4): 1305-1318.

• Qi Wu, Rob Law, Xin Xu. A sparse Gaussian process regression model for tourism demand forecasting in Hong Kong. Expert Systems with Applications. 39(5): 4769-4774.

• Jun Wu, Xin Xu, et al., A Novel Multi-agent Reinforcement Learning Approach for Job Scheduling in Grid Computing. Future Generation Computer Systems, 2011, 27(5): 430-439.

• Wei Wang, Xin Xu, Yan Li, Triple RRTs: An effective method for path planning in narrow passage, Advanced Robotics, 2010, vol. 24, no. 7, pp. 943-962. [pdf]

• Jian Li, Martin D. Levine, Xiangjing An, Xin Xu and Hangen He. Visual Saliency Based on Scale-Space Analysis in the Frequency Domain. submitted to IEEE Transactions on Pattern Analysis and Machine Intelligence, under second review, 2012

• Tingbo Hu, Tao Wu, Xin Xu, et al. Stereo Matching using Weighted Dynamic Programming on a Single-Direction Four-Connected Tree. Computer Vision and Image Understanding. In press. 2012

• Xin Liu, Xin Xu, Bin Dai. Long-Distance Lane Detection, Tracking and Front Vehicle Location for Full Autonomous Driving on Highway Roads. Journal of Central South University, 2012, in press.

• Xin Xu. Editorial: Special section on reinforcement learning and approximate dynamic programming. Journal of Intelligent Learning Systems and Applications, 2010, 2(2): 55-56.

• Gang wang, Xin Xu, Dewen Hu, et al. Uniqueness of maximum non-Gaussianity estimation: a revisit from the perspective of contrained cost-function optimization. International Journal of Intelligent Computing and Applications, 2008, 1(1):53-69

• Xin Xu, Han-gen He, A Gradient Algorithm for Neural-Network-Based Reinforcement Learning, Chinese Journal of Computers, 2003, 26(2): 227-233

• Xuening Wang, Xin Xu, Tao Wu, et al. The Optimal Reward Baseline for Policy-Gradient Reinforcement Learning. Chinese Journal of Computers, 2005, 28(6):1021-1026

• Jinshu Su, Bofeng Zhang, Xin Xu, Advances in Machine Learning Based Text Categorization. Journal of Software, 2006, 17(9):1848-1859

• Xin Xu, et al. Kernel-based Approximate Dynamic Programming for Real-time Online Learning Control: An Experimental Study. Submitted to IEEE Transactions on Control System Technology, under review.

• Chunming Liu, Xin Xu, Dewen Hu. Multi-Objective Reinforcement Learning: A Comprehensive Overview. Submitted to IEEE Transactions on System, Man, and Cybernetics, Part C, under review.

---

• Xin Xu, Peng Chengzhang, Bin Dai, Han-gen He. A Kernel-based Reinforcement Learning Approach to Stochastic Pole Balancing Control Systems, IEEE/ASME International Conference on Advanced Intelligent Mechatronics , 2010,

• Jun Wu, Xin Xu , Zhaobin Li, Yan Huang, and Jian Wang, Adaptive kernel-width selection for kernel-based least-squares policy ieration algorithm, Proceedings of IEEE International Symposium on Neural Networks, 2011

• Wei Wang, Yan Li, Xin Xu, Simon X. Yang: An adaptive roadmap guided Multi-RRTs strategy for single query path planning. International Conference on Robotics and Automation (ICRA), 2010: 2871-2876

• Pengcheng Zhang, Xin Xu, Chunming Liu, and Qiping Yuan. Reinforcement Learning Control of a Real Mobile Robot Using Approximate Policy Iteration. ISNN 2009, Part III, Lecture Notes in Computer Science, LNCS 5553, pp. 278-288, 2009.

• Xin Xu, Hongyu Zhang, Bin Dai, Han-gen He: Self-learning path-tracking control of autonomous vehicles using kernel-based approximate dynamic programming. Proc. of International Joint Conference on Neural Networks, 2008: 2182-2189

• Jun Wu, Xin Xu, Chuan-qiang Lian, Yan Huang. Adaptive dual heuristic programming based on delta-bar-delta learning Rule. Proceedings of International Symposium on Neural Networks, 2011

• Jun Wu, Xin Xu, Zhen-ping Sun, Yan Huang: Cooperative multi-agent reinforcement learning based on online heuristic extraction. ICNC 2011: 1299-1303

• Chunming Liu, Jinze Song, Xin Xu, and Pengcheng Zhang. Reordering Sparsification of Kernel Machines in Approximate Policy Iteration. ISNN 2009, Part II, Lecture Notes in Computer Science, LNCS 5552, pp. 398-407, 2009

• Xin Xu, Rob Law, Tao Wu: Classification of Business Travelers Using SVMs Combined with Kernel Principal Component Analysis. Lecture Notes in Artificial Intelligence, Proc. of ADMA 2007, LNCS: 524-532

• Chunming Liu, Xin Xu, et al. Adaptive Sample Collection Using Active Learning for Kernel-based Approximate Policy Iteration. In: Proc. of IEEE International Symposium on ADP and RL, Paris, 2011.

• Wei Wang, Xin Xu, Yan Li, Path Planning for Redundant Manipulator without Explicit Inverse Kinematics Solution. Proceedings of the 2009 IEEE International Conference on Robotics and Biomimetics, December 19 -23, 2009, Guilin, China

• Xin Xu, Yirong Luo: A Kernel-Based Reinforcement Learning Approach to Dynamic Behavior Modeling of Intrusion Detection. Lecture Notes in Computer Science,Proc. of ISNN (1) 2007: 455-464

• Xin Xu, Yongqiang Sun, Zunguo Huang: Defending DDoS Attacks Using Hidden Markov Models and Cooperative Reinforcement Learning. Lecture Notes in Computer Science, Proc. of PAISI 2007: 196-207

• Wei Chen, Xuening Wang, Tao Wu, Xin Xu: Visual Protractor Based Localization Algorithm for Mobile Robot. Proc. of ISDA (3) 2006: 67-71

• Gang Wang, Xin Xu, Dewen Hu: Local Stability Analysis of Maximum Nongaussianity Estimation in Independent Component Analysis. Lecture Notes in Computer Science, Proc. of ISNN (1) 2006: 1133-1139

• Xin Xu, Xuening Wang. An adaptive network intrusion detection method based on PCA and support vector machines. Lecture Notes in Artificial Intelligence, ADMA 2005: 696-703

• Xin Xu. A sparse kernel-based least-squares temporal difference algorithm for reinforcement learning. Lecture Notes in Computer Science, ICNC (1) 2006: 47-56

• Xin Xu, et al. A reinforcement learning approach for host-based intrusion detection using sequences of system calls. Lecture Notes in Computer Science, ICIC (1) 2005: 995-1003

• Xin Xu, Xuening Wang, Dewen Hu. Mobile robot path-tracking using an adaptive critic learning PD controller. Lecture Notes in Computer Science, ISNN(2), 2004: 25-34

• Xin Xu, et al. Text Categorization Using SVMs with Rocchio Ensemble for Internet Information Classification. Lecture Notes in Computer Science, ICCNMC, 2005, LNCS 3619, pp. 1022-1031,

• Xin Xu, et al. Autonomic Computing for Defense-in-Depth Information Assurance: Architecture and A Case Study, Lecture Notes in Computer Science, GCC, 2004, LNCS 3252, pp: 414-421.

• Xin Xu, et al. A Self-Learning Reactive Navigation Method for Mobile Robots. Proceedings of IEEE Int. Conference on Machine Learning and Cybemetics, 2003

• Gang Wang, Xin Xu, Global Convergence of FastICA: Theoretical Analysis and Practical Considerations. Lecture Notes in Computer Science, ICNC, 2005, 700-705

• Gang Wang, Xin Xu, Self-Adaptive FastICA Based on Generalized Gaussian Model. Lecture Notes in Computer Science, ISNN, 2005, 961-966

• Xin Xu, et al. Residual-gradient-based neural reinforcement learning for the optimal control of an acrobat. Proceedings of the 2002 IEEE International Symposium on Intelligent Control, Canada, 758- 763

---