深度学习：原理与应用实践

目 录
深度学习基础篇
第1 章 绪论 ·································································································· 2
1.1 引言 ······································································································· 2
1.1.1 Google 的深度学习成果 ···························································· 2
1.1.2 Microsoft 的深度学习成果························································· 3
1.1.3 国内公司的深度学习成果 ························································· 3
1.2 深度学习技术的发展历程 ···································································· 4
1.3 深度学习的应用领域 ············································································ 6
1.3.1 图像识别领域 ············································································· 6
1.3.2 语音识别领域 ············································································· 6
1.3.3 自然语言理解领域 ····································································· 7
1.4 如何开展深度学习的研究和应用开发 ················································· 7
本章参考文献 ······························································································ 11
第2 章 国内外深度学习技术研发现状及其产业化趋势 ······························· 13
2.1 Google 在深度学习领域的研发现状 ·················································· 13
2.1.1 深度学习在Google 的应用 ······················································ 13
2.1.2 Google 的TensorFlow 深度学习平台 ······································ 14
2.1.3 Google 的深度学习芯片TPU ·················································· 15
2.2 Facebook 在深度学习领域的研发现状 ·············································· 15
2.2.1 Torchnet ···················································································· 15
2.2.2 DeepText ··················································································· 16
2.3 百度在深度学习领域的研发现状 ······················································· 17
2.3.1 光学字符识别 ··········································································· 17
2.3.2 商品图像搜索 ··········································································· 17
2.3.3 在线广告 ·················································································· 18
2.3.4 以图搜图 ·················································································· 18
2.3.5 语音识别 ·················································································· 18
2.3.6 百度开源深度学习平台MXNet 及其改进的深度语音识别系统Warp-CTC ····· 19
2.4 阿里巴巴在深度学习领域的研发现状 ··············································· 19
2.4.1 拍立淘 ······················································································ 19
2.4.2 阿里小蜜——智能客服Messenger ········································· 20
2.5 京东在深度学习领域的研发现状 ······················································· 20
2.6 腾讯在深度学习领域的研发现状 ······················································· 21
2.7 科创型公司（基于深度学习的人脸识别系统） ······························· 22
2.8 深度学习的硬件支撑——NVIDIA GPU ············································ 23
本章参考文献 ······························································································ 24
深度学习理论篇
第3 章 神经网络 ························································································· 30
3.1 神经元的概念 ······················································································ 30
3.2 神经网络 ····························································································· 31
3.2.1 后向传播算法 ··········································································· 32
3.2.2 后向传播算法推导 ··································································· 33
3.3 神经网络算法示例 ·············································································· 36
本章参考文献 ······························································································ 38
第4 章 卷积神经网络 ················································································· 39
4.1 卷积神经网络特性 ················································································ 39
4.1.1 局部连接 ·················································································· 40
4.1.2 权值共享 ·················································································· 41
4.1.3 空间相关下采样 ······································································· 42
4.2 卷积神经网络操作 ·················4