You are on page 1of 76

DeepLearning

23158 936677

Python

10

118

jackyyang


4575

45
1.
BRETT

16
2.

31


58

PGM

26
1300ppt

Live
slideshare
slideshare.net/tw_dscon...
IBMCTO

pan.baidu.com/s/1nv54p9...3mty

RSA



1009080
10

10/10.
2017
y=f(x)=10x+303010x
y

:y=f(x)=5x+30xy

y=f(x)=5x+8x+35x+30
xxx

x
35
35.0
035x35.x

y/xyx

1.

2.

3.

1.

2.
3.

negative

()

w1w2...

w1w2......

1.

2.23ryry
23E
23

23
x

01


sigmoidRelu

f'(x)=f(x)*[1f(x)]

Reluf(x)x<0y0yx
Relux0y0.01x

SGDminibatchepoch

jackyyang

:)

20170203

4575 139



392
10

1/10

deeplearningPRMLpythonnumpyAndrewNgHinton
courserapapergithub

Python10Bayesian5onlinecourse

20170413

392 36



3583
Github,1000

Qix/dl.mdatmasterty4z2008/QixGitHub

(MachineLearning)&(DeepLearning)(Chapter1)Qix/dl.mdatmaster
ty4z2008/QixGitHub:500,Qix/dl.mdatmaster
ty4z2008/QixGitHub
:
.

BriefHistoryofMachineLearning

:SVM
AdaboostDeepLearning.part1

DeepLearninginNeuralNetworks:AnOverview

:JurgenSchmidhuber
1940608080902000
deeplearningtricks.

AGentleIntroductiontoScikitLearn:APythonMachineLearningLibrary

:python,python.
.

HowtoLayoutandManageYourMachineLearningProject

:
.

MachineLearningisFun!

:
,

:R,R

ChoosingaMachineLearningClassifier

:NaiveBayesLogistic
RegressionSVMFeatureModel
:52ml.net/15063.html

AnIntroductiontoDeepLearning:FromPerceptronstoDeepNetworks

TheLIONWay:MachineLearningplusIntelligentOptimization

:<>,300.
,,.,.
MLAPP/PRML,!:LIONbookintelligent
optimization.orgforprescriptiveanalytics

:20144
/.


:MITMathematicsforComputer

ScienceEricLehmanetal20135123
45

(FoundationsofDataScience)

,iTunes

DataSciencewithR

:
R

TwentyQuestionsforDonaldKnuth

:DonaldKnuthCharles
Leiserson,AlAho,JonBentleyKnuth20TAOCPP/NP

AutomaticConstructionandNaturalLanguageDescriptionofNonparametricRegression
Models

JoshuaB.TenenbaumZoubinGhahramaniautomatic
statistician...

ICLR2014

:representationlearning

IntroductiontoInformationRetrieval

ManningRaghavan
IntroductiontoInformationRetrieval
IRInformationRetrievalResources

Machinelearningin10pictures

:DenizYuret101.Bias/VarianceTradeoff2.
Overfitting3.Bayesian/Occam'srazor4.Featurecombination5.Irrelevantfeature6.Basis
function7.Discriminative/Generative8.Lossfunction9.Leastsquares10.Sparsity.

AnIntroductiontoStatisticalLearningwithApplicationsinR

TrevorHastieRobertTibshirani2014
StatisticalLearning

BestMachineLearningResourcesforGettingStarted

Mydeeplearningreadinglist

:BengioPAMIreview100
Presentationgoogle

CrossLanguageInformationRetrieval

1:
:IBM

2:
,3:

Adviceforstudentsofmachinelearning

DavidMimno
:"Youngman,inmathematics
youdon'tunderstandthings.Youjustgetusedtothem."

ExplorationsinParallelDistributedProcessing:A
HandbookofModels,Programs,andExercises,JamesL.McClelland
,DistributedDeepLearning

:JohnPlatt17
Platt
Platt

2014ICML2014

2014ICML62126
30
1200

MachineLearningforIndustry:ACaseStudy

LearningtoRankRankNet
NDCGNDCGLambdaRank
BoostedTreeLambdaMARTChirsBurgesYahoo2010
LearningtoRankChallengeRankNetLambdaRank
LambdaMARTLambdaMARTFromRankNettoLambdaRank
toLambdaMART:AnOverviewBurgesATutorialon
SupportVectorMachinesforPatternRecognition
SomeNotesonAppliedMathematicsforMachineLearning

100BestGitHub:DeepLearning

:100BestGitHub:DeepLearning

UFLDLAndrewNgDeepLearning

:
//

IIIIIIV
githubpythonUFLDLTutorialCode

*DeepLearningforNaturalLanguageProcessingandRelatedApplications

:,
,

UnderstandingConvolutions

MachineLearningSummerSchool

youtube.com/user/smolix

AwesomeMachineLearning


AwesomeAwesomeness,

:ACLChrisManning
ChromeIE

DeepLearningandShallowLearning

:DeepLearningShallowLearningMITChiyuan
Zhang

RecommendingmusiconSpotifywithdeeplearning

NeuralNetworksandDeepLearning

GitHub
mnielsen/neuralnetworksanddeeplearning:Codesamplesformybook"NeuralNetworksand
DeepLearning"

JavaMachineLearning

JavaNLPDeep
LearningJava

MachineLearningTheory:AnIntroductoryPrimer

/survey

Caltech

16FreeeBooksOnMachineLearning

:16pad

ALargesetofMachineLearningResourcesforBeginnerstoMavens

Sibyl
SibylYouTube

DeepLearning

YoshuaBengio,IanGoodfellow,AaronCourville

NeuralNetwork&TextMining

:(Deep)NeuralNetworksNLPTextMiningpaper

:1

DeepLearningimportantresourcesforlearningandunderstanding

:Importantresourcesforlearningandunderstanding.Isawesome

MachineLearningTheory:AnIntroductoryPrimer

NeuralNetworksandDeepLearning

:NeuralNetworksandDeepLearning

Python&&&&

:python17

()

:()

:google7

LevelUpYourMachineLearning

:0~4

MachineLearningSurveys

DeepLearningReadinglist

DeepLearning:MethodsandApplications

liPengDongYu

MachineLearningSummerSchool2014

:2014CMU50PDF
13
TomMitchellCMU.1080P

Sibyl:Google
:IEEE/IFIPDSNGoogleTushar

ChandraSibylSibyl
YouTubegooglesibyl

Buildingadeeperunderstandingofimages

:ChristianSzegedy
ImageNetGoogLeNet.

Bayesiannetworkpython

AMA:MichaelIJordan

:MichaelI.Jordan"10
Jordan:"10NASA"

&_16

:,
,

Videolectures25

GPUs

:KaggleTimDettmersGPUs,
GPU:t.cn/RhpuD1G

MichaelJordan

:MichaelJordan

DeepLearningKnowledgeGraph

:DeepLearning2,3

DeepLearning

:StanfordAndrewNgDeepLearning

DeepLearning101

UFLDLTutorial

TorontoDeepLearningDemos

:demo

Deeplearningfromthebottomup

:(CRANTaskViews,34,):



:
.

DeepLearning

:.

DeepLearning

DeepLearning

DeepLearning

DeepLearning

DeepLearning

DeepLearning

DeepLearning

TutorialsSessionADeepLearningforComputerVision

:RobFergusNIPS2013mp4,mp3,pdf
Facebook20148

FudanNLP

:FudanNLPNLP
FudanNLP

OpenSourcingmlease

:LinkedIn,,HadoopclusterSparkclusterlogistic
regression

GilbertStrang

Bigdata

machinelearningforsmartdummies

:
7SVM,boosting,nearestneighbors,decisiontrees

EntanglementBasedQuantumMachineLearning

:paper

HowaMathGeniusHackedOkCupidtoFindTrueLove
:WiredUCLAChrisMcKinlay1+

,Python122
60023

UnderactuatedRobotics

:MITUnderactuatedRobotics2014101MIT

mllib(1)

:mllib

GoogleTurnsToDeepLearningClassificationToFightWebSpam

:GoogleDeepLearningantispam()

NLP

:NLP*NLP

BestPapersvs.TopCitedPapersinComputerScience

1996

InfiniTAM:

ACMTrans.onGraphics(TOG)
3DOnlinelearningGPU
RandomforestGPUCRF

Hacker'sguidetoNeuralNetworks

DeepLearning
ConvNetJSkarpathy

BuildingaProductionMachineLearningInfrastructure

GoogleJoshWills,

DeepLearningSentimentAnalysisforMovieReviewsusingNeo4j

Neo4j

DeepLearning.UniversityAnAnnotatedDeepLearningBibliography

Aprimerondeepinglearning

Machinelearningisteachingusthesecrettoteaching

scikitlearnPython

scikitlearnSciPyPython

MichaelJordan

MichaelI.Jordan



A*

A*,g(n)+h(n):g(n)
nh(n)n

FudanNLP

MicrosoftAzureNLPonAzureWebsite
FNLPRESTAPIFNLP

&

2014

AmundTveit
DeepLearning.University2014
,github

EMNLP

EMNLPstocktrenddeepmodelExploitingSocialRelations
andSentimentforStockPredictionstocknetwork

BengioLISA

Bengio

NeuralTuringMachine

function
PythonLearningtoExecute

LearningtoRankforInformationRetrievalandNaturalLanguageProcessing

Rumorhasit:IdentifyingMisinformationinMicroblogs

,
paper.

MahoutRapidminerHadoopSparkStorm
BIGDATAANALYTICSBEYONDHADOOP

Hartley
GonzalezRafaelC.Gonzalez/RichardE.Woods

LinkedInBrowsemaps
CFLinkedIn

log

NLP

NLP

LeoBreimanStatisticalModeling:TheTwoCultures

FrancisBach()SparseModelingforImageandVision
ProcessingSparsity,DictionaryLearning,PCA,MatrixFactorization
Whydoesthel1norminducesparsity

ReproducingKernelHilbertSpace

RKHSlargemargin
RKHSBanachHilbert
12

Hacker'sguidetoNeuralNetworks

AndrejKarpathy
JavascriptSVM.

ReproducibleResearchinComputationalScience

NYU2014

NYU2014

MachineLearningOpenSourceSoftware

LIBSVM

ALibraryforSupportVectorMachines

SupportVectorMachines

100BestGitHub:DeepLearning

github100
(UCI)

306

AndrejKarpathy

AndrejKarpathyLiFeiFei

stateofart.

AndrejKarpathy

AndrejKarpathy

CIKM

CIKMCup(CIKMCompetition)ACMCIKM

GeoffreyE.Hinton

FRS

CIKM2014

<>ApacheSparkSparkMLLib
()GitHub
.

UndergraduatemachinelearningatUBC

""PPT

""PPT


.

CIKM2014

CIKM2014JeffDeanQiLuGerhardWeikumAlexSmola
LimsoonWongTongZhangChihJenLinIndustryTrack

PythonSMOSVM

:AdaBoost python

NumericalOptimization:UnderstandingLBFGS

:AriaHaghighi
BFGSLBFGS,

Rlanguageforprogrammers

UseGoogle'sWord2Vecformoviereviews

:KaggleWhenbagofwordsmeetsbagsofpopcornakaword2vecdeep
learningNLPpythongensimword2vec
gensim

PyNLPIR

:PyNLPIRNLPIR/ICTCLASPython,Zhon
CJK

:16
10

NIPS

:UTAustinEricPriceNIPS,
NIPS

2014

:KDNuggets201414
RPython

PythonLinearRegression

:Python,

201433PDF

201433PDF

RNNParagraphVector

T.Mikolov&Y.BengioEnsembleofGenerativeandDiscriminative
TechniquesforSentimentAnalysisofMovieReviewsRNNPV
(https://github.com/mesnilgr/iclr15)github()Paragraph
Vector

NLPIR/ICTCLAS2015

:NLPIR/ICTCLAS2015

MachineLearningisFun!

:ConvexNeuralNetworks

CNN

:CNNbpCNNMLP
bpCNNbp
:

Trie

:AhoCorasickTrie

TrieRegexp::Trie

DeeplearningReadingList

Caffe

:CaffegoogleYangqingJia()

GoogLeNetCaffe

:2014ImageNetGoogLeNetCaffe,GoogleNet.

LambdaNetHaskell

:LambdaNetLambdaNetHaskell

&

TEDxNanjing

:"IBM

"
TEDxNanjing

RNN/LSTM0)ConnectionistTemporal
ClassificationICML06

:1)SequencetoSequenceNIPS142)GRAMMARASFOREIGN
LANGUAGE

DeepLearningword2vec
:word2vec/>NNLM

>LogLinear/LogBilinear>LogBilinearCBOWSkipgramword2vec
tricksword2vecword2vec

Machinelearningopensourcesoftware

:,
:DMOZComputers:ArtificialIntelligence:MachineLearning:
Software, LIBSVMALibraryforSupportVectorMachines, Weka3:DataMiningSoftwarein
Java, scikitlearn:MachineLearninginPython, NaturalLanguageToolkit:NLTK, MAchine
LearningforLanguagEToolkit, DataMiningFruitfulandFun, OpenSourceComputerVision
Library

:(2015)

ATourofMachineLearningAlgorithms

2014

Imageclassificationwithdeeplearning

:BengioSamy0931989
94RajReddy

NLP

:360,NLP

Usingconvolutionalneuralnetstodetectfacialkeypointstutorial

:deeplearningAWS

:AdvancedStructuredPrediction

:SebastianNowozinMITAdvancedStructured
Predictiont.cn/RZxipKGCVNLP
:,,,,

AnIntroductiontoMatrixConcentrationInequalities

:Tropp
paper

Thefreebigdatasourcesyoushouldknow

:
Data.govUSCensus
BureauEuropeanUnionOpenDataPortalData.gov.uk

ABriefOverviewofDeepLearning

:HintonIlyaSutskever

ADeepDiveintoRecurrentNeuralNets
:RNN

NikhilBudumaDeepLearninginaNutshell

:demo

Statisticalfoundationsofmachinelearning

:
R

ADeepLearningTutorial:FromPerceptronstoDeepNetworks

:IVANVASILEV

Researchprioritiesforrobustandbeneficialartificialintelligence

:,StuartRussell,Tom
Dietterich,EricHorvitz,YannLeCun,PeterNorvig,TomMitchell,GeoffreyHinton,ElonMusk
TheFutureofLifeInstitute(FLI).ElonMuskAI
AI
AIVerificationValidity,Security,Control
AI,
AI

metacademy

FAIRopensourcesdeeplearningmodulesforTorch

:FacebookFAIR
Facebook
Torch

Haar

:2012

:PeterHarrington

Deeplearningfromthebottomup

HandsOnDataSciencewithRTextMining

:R

UnderstandingConvolutions

:ConvNets:AModular
PerspectiveGroups&GroupConvolutions.

IntroductiontoDeepLearningAlgorithms

:DeepLearning063deeplearning

LearningDeepArchitecturesforAI

:YoshuaBengio

GeoffreyE.Hinton
:GeoffreyHintonDeepLearning

PROBABILITYTHEORY:THELOGICOFSCIENCE

H2O

ICLR2015arXiv

IntroductiontoInformationRetrieval

:IR

InformationGeometryanditsApplicationstoMachineLearning

LegalAnalyticsIntroductiontotheCourse

:
GenerativeModelDiscriminativeModel

NeuralTalk

:NeuralTalkisaPython+numpyprojectforlearningMultimodalRecurrentNeuralNetworks
thatdescribeimageswithsentences.NeuralTalkPython
Google(VinyalsCNN+LSTM)(Karpathy
andFeiFeiCNN+RNN)NeuralTalk

DeepLearningonHadoop2.0

:Hadoop2.0,paypal

Practicalrecommendationsforgradientbasedtrainingofdeeparchitectures

:,YoshuaBengio.
@xuewei4d

MachineLearningWithStatisticalAndCausalMethods

MachineLearningCourse180

:Youtube160

(regression)(gradientdescent)

DeepLearningforAnswerSentenceSelection

:

LearningSemanticRepresentationsUsingConvolutionalNeuralNetworksforWebSearch

:CNNWEB

AwesomePublicDatasets

:Awesome

SearchEngine&Community

spaCy

:PythonCythonNLP
CythonhashNLP

CollaborativeFilteringwithSpark

:Fields,pptFieldsRussSalakhutdinov

Topicmodeling

:Topicmodeling,

MoveEvaluationinGoUsingDeepConvolutionalNeuralNetworks

:Google

:paper,booksystem,CES,Roboot

Learningmorelikeahuman:18freeeBooksonMachineLearning

:18freeeBooksonMachineLearning

Recommend:HangLiHome

:ChiefscientistofNoah'sArkLabofHuaweiTechnologies.HeworkedattheResearch
LaboratoriesofNECCorporationduring1990and2001andMicrosoftResearchAsiaduring2001
and2012.Paper

DEEPLEARNING.UNIVERSITYANANNOTATEDDEEPLEARNING
BIBLIOGRAPHY

:DEEPLEARNING.UNIVERSITY963

MLMU.czRadimehekWord2vec&friends(7.1.2015)

:Radimehek(Gensim)word2vec
.

IntroducingstreamingkmeansinSpark1.2

:
SparkMLlib1.2StreamingKmeansJeremyFreeman
1TB

LDAJava

:LDAJava
LDAarbylonLdaGibbsSampler
GitHub

AMinerOpenSciencePlatform

:AMiner
4000800018

WhataresomeinterestingWord2Vecresults?

:QuoraWord2VecOmerLevyCoNLL2014
DanielHammack(Python)

:,

AFirstCourseinLinearAlgebra

:AFirstCourseinLinearAlgebraRobertBeezerGNU
1813

libfacedetection

:libfacedetection
.:(OpenCVhaar+adaboost23),(FDDB

InvertingaSteadyState

:WSDM2015propagationmodel

TheTroublewithSVMs

:
SVM
SVMnofreelunch

RiseoftheMachines

:CMULarryWasserman,

GaussianProcessesforMachineLearning

:
,

FuzzyWuzzy:FuzzyStringMatchinginPython

:Pythonratio()partial_ratio(
)token_sort_ratio()token_set_ratio()github

Blocks
:BlocksTheano

NN.

IntroductiontoMachineLearning

:AlexSmolaCMUIntroductiontoMachine
Learning4KYoutube2.4Exponential
Families,playlist,.

CollaborativeFeatureLearningfromSocialMedia

:
()
.

Introducingpracticalandrobustanomalydetectioninatimeseries

:Twitter(SHESD)R

EmpowerYourTeamtoDealwithDataQualityIssues

:
()22(
)

:.

DeepLearningSummit,SanFrancisco,2015

:15,

IntroductiontoConditionalRandomFields

:(CRF),

AFastandAccurateDependencyParserusingNeuralNetworks

:Stanford

WhichGPU(s)toGetforDeepLearning:MyExperienceandAdviceforUsingGPUsin
DeepLearning

:GPU

SparseLinearModels

:StanfordTrevorHastieH2O.aiMeetUp
(),13.

AwesomeComputerVision

:Awesome!

AdamSzeidl

:socialnetworkscourse

Buildinganddeployinglargescalemachinelearningpipelines

:.

:.
UnderstandingNaturalLanguagewithDeepNeuralNetworksUsingTorch

:TorchNLPFacebook.

TheNLPEngine:AUniversalTuringMachineforNLP

:CMUEdHovyStanfordJiweiLiArxiv,ShannonEntropy
NLP.

TTheProbabilisticRelevanceFramework:BM25andBeyond

:BM25(BestingMatching)12
IDFTF
3BM11BM154BM25Okapi
Robertson.

IntroductiontoARMATimeSeriesModelssimplified

:(ARMA)ARMA
ARMA.

EncodingSourceLanguagewithConvolutionalNeuralNetworkforMachineTranslation

:targetattentionsignalsourceencodingCNNBBN
neuralnetworkjointmodel

SpicesformthebasisoffoodpairinginIndiancuisine

HMM

:HMM,HMM

Zipf'sandHeap'slaw

:1),(Zipf,19021950)1949Zipfs
law,.(Mandelbrot,19242010)
2)Heaps'law:(,0.40.6)

IamJrgenSchmidhuber,AMA

:JrgenSchmidhuberRedditAMA(AskMeAnything)RNNAIML
&&&.

AcademicTorrents

:GTHN,NLPSNA
BTRSS

:ScikitLearnCheatSheetScikitLearn

AFullHardwareGuidetoDeepLearning

:GPURAMCPUSSDPCIe

(PedestrianDetection)

:PedestrianDetectionpaper&data

Aspecializedfaceprocessingnetworkconsistentwiththerepresentationalgeometryof
monkeyfacepatches

:
FFA
KhalighRazaviFFA

NeuralNetinC++Tutorial

:C++,BP

HowtoChooseaNeuralNetwork

:deeplearning4jNN

DeepLearning(Python,C/C++,Java,Scala,Go)

:,Python,C/C++,Java,Scala,Go

DeepLearningTutorials

:,github

:.

FaceNet:AUnifiedEmbeddingforFaceRecognitionandClustering

:GoogleFacebookDeepFaceFaceNetLFW(LabeledFacesinthe
Wild)99.63%()FaceNetembeddings.

MLlibRandomForestsBoosting

:DatabricksJosephBradleyManishAmde
RandomForestsGradientBoostedTreesGBTsMLlib
..

SumProductNetworks(SPN)

:PedroDomingosDNN.

NeuralNetworkDependencyParser

:(StanfordCoreNLP)
AFastandAccurateDependencyParserUsingNeural
Networks.

:
NNLM[Bengio,2003]HierarchicalNNLM[Bengio,2005],LogBilinear[Hinton,
2007],SENNA.

ClassifyingSpamEmailsusingTextandReadabilityFeatures

BCIChallenge@NER2015

:Kaggle(BCI)
PythonKaggle

IPOLJournalImageProcessingOnLine

:IPOL
DemoIPOL
.

Machinelearningclassificationoverencrypteddata
:MIT.

purine2

:LVPurine:Abigraphbaseddeeplearningframework,
12Titan20
Googlenet

MachineLearningResources

:,...zheng
Rui.

Handsonwithmachinelearning

:ChaseDavisNICAR15ScikitLearn.

TheNaturalLanguageProcessingDictionary

:,1998,
..

PageRankApproachtoRankingNationalFootballTeams

:1930PageRank.

RTutorial

:R,RAnIntroductiontoR.

Fastunfoldingofcommunitiesinlargenetworks

:GephiCommunitydetection.

NUML

:.net,github

synaptic.Js

:node.jsJSLSTMgithub

MachinelearningforpackageuserswithR(1):DecisionTree

DeepLearning,TheCurseofDimensionality,andAutoencoders

:,

AdvancedOptimizationandRandomizedMethods

:CMUA.SmolaS.Sra
()

CS231n:ConvolutionalNeuralNetworksforVisualRecognition

:"CNN".

TopicmodelingwithLDA:MLlibmeetsGraphX

:SparkMLlib+GraphXLDA.

DeepLearningforMultilabelClassification

:,RBMDBN()

GoogleDeepMindpublications

:DeepMind
kaldi

:,sourceforge

DataJournalismHandbook

:,,

DataMiningProblemsinRetail

:.

UnderstandingConvolutioninDeepLearning

:,.

pandas:powerfulPythondataanalysistoolkit

:Python.

TextAnalytics2015

:2015().

DeepLearninglibrariesandrstexperimentswithTheano

:Theano.

DEEPlearning

:MITYoshuaBengioDraftchapters
.

simplebayes

:Python.

Paracel

:Paracelisadistributedcomputationalframeworkdesignedformachinelearningproblems,
graphalgorithmsandscientificcomputinginC++.

HanLP:HanLanguageprocessing

:.

SimpleNeuralNetworkimplementationinRuby

:Ruby.

Hacker'sguidetoNeuralNetworks

:.

TheOpenSourceDataScienceMasters

:,.

TextUnderstandingfromScratch

:githubCrepe

ImprovingDistributionalSimilaritywithLessonsLearnedfromWordEmbeddings

:word2vec
GloVeword2vec.

CS224d:DeepLearningforNaturalLanguageProcessing

:Stanford,RichardSocher.

MathEssentialsinMachineLearning

:.

ImprovedSemanticRepresentationsFromTreeStructuredLongShortTermMemory
Networks

:LSTM,.
.

StatisticalMachineLearning

:RyanTibshiraniLarryWasserman
(10715)(36705).

AM207:MonteCarloMethods,StochasticOptimization

:VKaynig
FittkauPProtopapasPython
IPN.

SPARK

:SPARK.bigdatagenomicsADAM
.

ACLAnthology

:
idea
,,.

TwitterSentimentDetectionviaEnsembleClassificationUsingAveragedConfidence
Scores

:+:Twitter,.

NIPS2014CIMLworkshop

:NIPSCiML2014PPT,NIPS.

CS231n:ConvolutionalNeuralNetworksforVisualRecognition

:Projects
.

ASpeedComparisonBetweenFlexibleLinearRegressionAlternativesinR

:Rlm()nls()glm()bayesglm()nls()
mle2()optim()Stansoptimizing().

BacktoBasicsWeekendReadingMachineLearning

:
Domnigos

AProbabilisticTheoryofDeepLearning

:RiceUniversity.

NonsensicalbeerreviewsviaMarkovchains

:Twitter,github.

DeepLearningforNaturalLanguageProcessing(withoutMagic)

:+:(NAACL13).

IntroductiontoDataAnalysisusingMachineLearning
:,DavidTaylorMcGillUniversity

ipnGitHub.

BeyondShortSnippets:DeepNetworksforVideoClassification

:CNN+LSTM,google.

HowdoesQuorausemachinelearningin2015?

:Quora.

AmazonMachineLearningMakeDataDrivenDecisionsatScale

:,.

ParallelMachineLearningwithscikitlearnandIPython

:(scikitlearnIPython).notebook

Introtomachinelearningwithscikitlearn

:DataSchool.

DeepCLn

:OpenGLLinuxWindows.

AnInsideLookattheComponentsofaRecommendationEngine

:MahoutElasticsearch.

ForecastinginEconomics,Business,FinanceandBeyond

:FrancisX.Diebold(||).

TimeSeriesEconometricsAConciseCourse

:FrancisX.Diebold.

Acomparisonofopensourcetoolsforsentimentanalysis

:Yelp,NaiveBayesSentiWordNetCoreNLP
.

PatternRecognitionAndMachineLearning

:PatternRecognitionAndMachineLearning,pdf,.

ProbabilisticDataStructuresforWebAnalyticsandDataMining

:Web.

Machinelearninginnavigationdevices:detectmaneuversusingaccelerometerand
gyroscope

:.

NeuralNetworksDemystified

:NeuralNetworksDemystifiedStephenWelch,
.

swirl+DataCamp

:{swirl}:R&.

LearningtoReadwithRecurrentNeuralNetworks

:RNNSequencetoSequenceLearningwithNeuralNetworks.

DeepReinforcementLearning
:DeepReinforcementLearning.

MachineLearningwithScikitLearn

:(PyCon2015)ScikitLearn,ParallelMachineLearningwithscikitlearnand
IPython.

PDNN

:PDNN:APythonToolkitforDeepLearning.

IntroductiontoMachineLearning

:15CMUAlexSmola.
.

BigDataProcessing

:.MapReduce.

SparkMLlib:MakingPracticalMachineLearningEasyandScalable

:SparkMLlib,.

Picture:AProbabilisticProgrammingLanguageforScenePerception

:()50.

BeautifulplottinginR:Aggplot2cheatsheet

:ggplot2,,AnewdataprocessingworkflowforR:dplyr,
magrittr,tidyr,ggplot2.

UsingStructuredEventstoPredictStockPriceMovement:AnEmpiricalInvestigation

:.

InternationalJointConferenceonArtificialIntelligenceAcceptedpaper

:,Google.

WhyGEMMisattheheartofdeeplearning

:(GEMM).

Distributed(Deep)MachineLearningCommon

:ACommunityofawesomeDistributedMachineLearningC++projects.

ReinforcementLearning:AnIntroduction

:<>,(1998),(2015),,Reinforcement
Learning.

Freeebook:MicrosoftAzureEssentials:AzureMachineLearning

::AzureML.

ADeepLearningTutorial:FromPerceptronstoDeepNetworks

:ADeepLearningTutorial:FromPerceptronstoDeepNetworks.

MachineLearningisFun!TheworldseasiestintroductiontoMachineLearning

:,.

ABriefOverviewofDeepLearning

:,.

Wormhole
:Portable,scalableandreliabledistributedmachinelearning.

convnetbenchmarks

:CNN,CaffeTorch7CuDNNcudaconvnet2fbfft
NervanaSystemsNervanaSys.

ThiscataloguelistsresourcesdevelopedbyfacultyandstudentsoftheLanguage
TechnologiesInstitute.

:,NLP
.

SentimentAnalysisonTwitter

:TwitterSentiTweet,+.

MachineLearningRepository@WashU

:MachineLearningPaperRepository.

Machinelearningcheatsheet

:.

Sparksummiteast2015agenda

:Sparksummit.

Sparksummiteast2015agenda

:Sparksummit.

LearningSpark

:EbookLearningSpark.

AdvancedAnalyticswithSpark,EarlyReleaseEdition

:EbookAdvancedAnalyticswithSpark,EarlyReleaseEdition.

:Arnetminer
.

:.

:multilabel.

:.

:GoogleGoogle
,.

CatPaperCollection

:.

HowtoEvaluateMachineLearningModels,Part1:Orientation

:,HowtoEvaluateMachineLearningModels,Part2a:
ClassificationMetrics,HowtoEvaluateMachineLearningModels,Part2b:Rankingand
RegressionMetrics.

Buildinganewtrendsexperience

:Twittertrends.

StormBlueprints:PatternsforDistributedRealtimeComputation

:Storm,.

SmileMiner

:JavaSmileMiner.

:SimonPeytonJonesHowtowriteagoodresearch
paperHowtoWriteaGreatResearchPaper,howtopapertalk.

TricksBP

:TricksBP,.

NLP

:NLP,.

ThehIndexforComputerScience

:UCLAJensPalsbergGoogleScholarHindex,
135
/300ACMFellow,google
,.

StructuredLearningforTaxonomyInductionwithBeliefPropagation

loopypropagationmarginalprobability.

Bayesiananalysis

:,250,R
,.

deepnethighlightsfrom2014

:deepnethighlightsfrom2014.

FastRCNN

:ThispaperproposesFastRCNN,acleanandfastframeworkforobjectdetection.

FingerprintingImagesforNearDuplicateDetection

:,,.

TheComputerVisionIndustry

:.

AR
web.

Seaborn:statisticaldatavisualization

:Python.

IPythonlecturenotesforOCWMIT18.06
:GilbertStrang,GilbertStrangLinearAlgebra

+.

Canova:AVectorizationLibforML

:/Canova,github,CSVMNISTTF
IDF/BagofWords/word2vec.

DZoneRefcardz:DistributedMachineLearningwithApacheMahout

:ApacheMahout.

Learningscikitlearn:MachineLearninginPython

:scikitlearnSVMNBPCADT
.

LightningfastMachineLearningwithSpark

:Spark,.

Howwereusingmachinelearningtofightshellselling

:WePay"shellselling".

DataScientistsThoughtsthatInspiredMe

:16.

Deeplearningapplicationsandchallengesinbigdataanalytics

:.

Freebook:MachineLearning,Mathematics

:,,,,.

Objectdetectionviaamultiregion&semanticsegmentationawareCNNmodel

:CNNPaper.

AStatisticalViewofDeepLearning(V):GeneralisationandRegularisation

:V:.

HighwayNetworks

:SGD()HN.

WhatIReadForDeepLearning

:.

AnIntroductiontoRecommendationEngines

:CourseraIntroductiontoRecommenderSystems.

StanfordMachineLearning

:AndrewNg.

ICLR2015

:ICLR2015,.

StanfordMachineLearning

:"".

TheMoreExcitedWeAre,TheShorterWeTweet

:MITTwitter.

:.

NeuralTuringMachinesimplementation

:(NTM),,.

ComputerVisionCSE559A,Spring2015

:(2015),ComputerVision:AlgorithmsandApplications.

MiningofMassiveDatasets

:"MiningofMassiveDatasets",JureLeskovec,AnandRajaraman,JeffUllman
JureLeskovec,
.

LearningDeepLearning

:,.

LearningDeepLearning

:"LearningDeepLearning".

Tutorial:MachineLearningforAstronomywithScikitlearn

:MachineLearningforAstronomywithscikitlearn.

AnIntroductiontoRandomForestsforBeginners

:"".

Top10dataminingalgorithmsinplainEnglish

:.

AnInsideLookattheComponentsofaRecommendationEngine

:MahoutElasticsearch,.

AdvancesinExtremeLearningMachines

::ELM.

10minutetourofpandas

:Pandas,ipn.

Datadoesn'tgrowintables:harvestingjournalisticinsightfromdocuments

:.

TimelapseMiningfromInternetPhotos

:(SIGGRAPH2015).

TheCurseofDimensionalityinclassification

:.

DeepLearningvsBigData:Whoownswhat?

:vs.,[](vs.
CSDN.NET

APrimeronPredictiveModels

:.
DemistifyingLSTMNeuralNetworks

:LSTM.

ICLR2015

:2015ICLR.

OnVisualizingDataWell

:BenJones.

DecodingDimensionalityReduction,PCAandSVD

:/PCA/SVD.

Supervisedlearningsuperstitionscheatsheet

:IPN:/,logistic,,SVM,KNN,NaiveBayes
.

DopeLearning:AComputationalApproachtoRapLyricsGeneration

:RankSVMDNN()Rap.

AnIntroductiontoRandomIndexing

:RI.

VDiscover

:VDiscover.

Minerva

:minervapythonGPU4GPU
4GoogLeNet68.7%top189.0%top5dmlccxxnet
cxxnetmxnet
.

CVPR2015paper

:2015paper.

Whataretheadvantagesofdifferentclassificationalgorithms?

:Netflix,.

ResultsforMicrosoftCOCOImageCaptioningChallenge

:Codalab+,Redditflukeskywalker.

CaffeconTroll:ShallowIdeastoSpeedUpDeepLearning

:CaffeCcT.

Lowprecisionstoragefordeeplearning

:()().

ModelBasedMachineLearning(EarlyAccess)

::.

RegretAnalysisofStochasticandNonstochasticMultiarmedBanditProblems

:,IntroductiontoBandits:AlgorithmsandTheory.

KaggleRTutorialonMachineLearing
:Kaggle'sTitanicCompetitionR,InteractiveRTutorial:

MachineLearningfortheTitanicCompetition.

DeepLearning

:DeepLearning.

IntroductiontoNeuralMachineTranslationwithGPUs

:().

AndrewNg:DeepLearning,SelfTaughtLearningandUnsupervisedFeatureLearning

:AndrewNg//,.

RecurrentNeuralNetworkTrainingwithDarkKnowledgeTransfer

::RNN.

ShowMeTheMoney

:.

pyLDAvis

:(Python)pyLDAvis.

LogisticRegressionandGradientDescent

:Logistic.

:caffe.

sketch

:Theano/BlocksRNNsketch.

WebScaleDocumentClustering:Clustering733MillionWebPages

:TopSig(7+).

NAACL2015ProceedingsonACLAnthology

:NAACL2015papers.

StockForecastingWithMachineLearningSevenPossibleErrors

:.

Arethereanygoodresourcesforlearningaboutneuralnetworks?

:.

ACriticalReviewofRecurrentNeuralNetworksforSequenceLearning

:RNN.

HandlingandProcessingStringsinR

:R.

MustwatchvideosaboutPython

:Python.

TheGoogleStack

:Google().

RandomizedAlgorithmsforMatricesandData
:(UCBerkeley2013).

IntermediateR

:DataCampR.

TopologyWithoutTears

::,.

InformationTheory,PatternRecognition,andNeuralNetworks

:Book,video.

Scikitlearn

:ScikitlearnScipyPython
Gradient
BoostingDBSCANPythonnumericalscientificlibrariesNumpy
andScipy

Pylearn2

:PylearnTheano

NuPIC

:NuPICHTMHTMHTM
NuPIC,

Nilearn

:NilearnPythonPython
scikitlearn

PyBrain

:PybrainPython

Pattern

:PatternPython
KNN

Fuel

:FuelMNIST,CIFAR10(),
GooglesOneBillionWords()

Bob

:BobPythonC++
,

Skdata

:Skdata
Python

MILK
:MILKPythonSVMS,KNN,

,
MILKKmeans

IEPY

:IEPY

Quepy

:QuepyPython

QuepySparqlMQL

Hebel

:HebelPythonPyCUDA
GPUCUDA

mlxtend

nolearn

:
scikitlearn

Ramp

:RampPython
pandasbasedPython
scikitlearn,rpy2Ramp

FeatureForge

:scikitlearnAPI
scikitlearn

REP

:REP
TMVA,Sklearn,XGBoost,uBoost

Python

PythonELM

:Pythonscikitlearn

DimensionReduction

:,DimensionalityReductionAShortTutorialMatlabToolboxfor
DimensionalityReductionUnsupervisedKernelDimensionReduction

DatasetsUsedForBenchmarkingDeepLearningAlgorithms

:deeplearning.net.

GolangNaturalLanguageProcessing
:Go.

RehabilitationofCountbasedModelsforWordVectorRepresentations

:,ImprovingDistributionalSimilaritywithLessonsLearnedfrom
WordEmbeddings

ThreeAspectsofPredictiveModeling

:.

CS224d:DeepLearningforNaturalLanguageProcessing

:,

GoogleComputerVisionresearchatCVPR2015

:CVPR2015GoogleCV.

UsingDeepLearningtoFindBasketballHighlights

:(Metamind).

Qix

20160316

3583 115

Deeper
\\
1044

LeCunBengioHinton2015NatureDeepLearning
presentationMichaelNielsen

Colah

ACriticalReviewofRecurrentNeuralNetworksforSequence
LearningRNN
CNNRBMDeeplearning4j
UFLDL

1.Sigmoid

BP

2.

TahnXavier:

ReLUMSRAFiller(SrurpassingHuman)
3.

word2vec()NLP
CBOWskipgramHuffmanHierarchical
Softmaxnegativesampling

4.RBM
GibbsKL

GAN
EvolvingAILab
UniversityofWyoming

DCGANImageCompletionwithDeepLearninginTensorFlow

5.

152ImageNe

6.

NIPS2016KillanWeinberger
CIFAR101202
7.

LSTMGRU
RNNNLPRNNLM

RNNLMRNNLSTMGRU
LSTMLSTM:ASearchSpaceOdyssey

RNNDeepVisualSemanticAlignmentsfor
GeneratingImageDescriptionsGAN

RNNattention
App""attentionbasedRNN
encoderdecoder

8.

CNNRNN
DeepSpeech2:

20170302

1044 73

190

15CMU
16FacebookAppliedMachineLearning(AML)
caffe2

iOSiOS
iOSXcodedefault
iOS

iOS

rcnn
resnetgan

NNNN
FBlandmentor
@landland
10land@
pitchMxnetrepo
LSTM+CTCtrainTIMIT@
epoch

20170222

190 24

Spark
(255,255,255)

412
medium.mybridge.co/mach...

Medium201710
1014500
100.069%

DeepLearning,A.I.,NaturalLanguageProcessing,FaceRecognition,
Tensorflow,ReinforcementLearning,NeuralNetworks,AlphaGo,SelfDrivingCar.

Rank1

UnsupervisedFeatureLearningandDeepLearningTutorial

AndrewNg
CNNSelfTaughtLearning

Rank2

TeachingYourComputerToPlaySuperMarioBros.

DeepMindDeepMind

Rank3

ABeginner&ampampampamp#x27sGuideToUnderstandingConvolutionalNeuralNetworks
Part1
ABeginner&ampampampamp#x27sGuideToUnderstandingConvolutionalNeuralNetworks
Part2
The9DeepLearningPapersYouNeedToKnowAbout(UnderstandingCNNsPart3)

Rank4

medium.com/@ageitgey/ma...

Rank5

medium.com/learningnew...

MachineLearninginaweekmedium.com/learningnew...

Rank6

https://www.facebook.com/notes/markzuckerberg/buildingjarvis/10154361492931634?
utm_source=mybridge&ampampampamputm_medium=blog&ampampampamputm_campaign=r
ead_more

JarvisAIFacebook
Zuckerberg2016
Rank7

ImageCompletionwithDeepLearninginTensorFlow

TensorFlowImageCompletion

Rank8

TheNeuralNetworkZooTheAsimovInstitute

SVM
DCNDBN

Rank9

HowtoCodeandUnderstandDeepMind&ampampampamp#x27sNeuralStackMachine

Rank10

youtube.com/watch?...

Youtube

OpenSource

2016

neuralenhanceSuperResolutionforimagesusingdeeplearning.

github6297

dennybritz/reinforcementlearning

Python,OpenAIGym,Tensorflow

ReinforcementLearning:AnIntroduction(2ndEdition)

DavidSilver&ampampampamp#x27sReinforcementLearningCourse

lengstrom/faststyletransfer

Prisma

DataScience:DeepLearninginPythonUdemy

MachineLearningAZ:HandsOnPython&ampampampampampRInDataScience

Avisualintroductiontomachinelearning

ps

40InterviewQuestionsaskedatStartupsinMachineLearning/DataScience

40

20170403

412 11


|||

914

Tutorial

DeepLearningTutorialfromStanfordStanfordtutorialAndrewNg
DL

TheLearningMachines

DeepLearning(ReviewArticleinNature,May2015)YannLeCun,YoshuaBengio,and
GeoffreyHinton

GrowingPainsinDeepLearning

DeepLearninginNeuralNetworksThistechnicalreportprovidesanoverviewofdeep
learningandrelatedtechniqueswithaspecialfocusondevelopmentsinrecentyears.
20122014

NeuralNetworksforMachineLearningGeoffreyHintonCourseraMOOC

OxfordDeepLearningNandodeFreitasOxford

DeepLearningYoshuaBengio,IanGoodfellowandAaronCourvilleDL

H2OJava,Python,Scala,andR

Deeplearning4jJavaHadoopSpark

CaffeYangqingJiaBerkeley

TheanoPython

News

DeepLearningNews

So

YoshuaBengio
CVNLP

PageonToronto,HomePageofGeoffreyHinton
PageonToronto,HomePageofRuslanRSalakhutdinov
PageonWustl,ynd/cae.pyGitHub
PageonIcml,https://github.com/lisalab/pyle...
PageonJmlr,pylearn2)
Onthedifficultyoftrainingrecurrentneuralnetworks,trainingRNNs
ImageNetClassificationwithDeepConvolutionalNeuralNetworks,cudaconvnetHigh
performanceC++/CUDAimplementationofconvolutionalneuralnetworksGoogleProject
Hosting
LinguisticRegularitiesinContinuousSpaceWordRepresentations,word2vecToolfor
computingcontinuousdistributedrepresentationsofwords.GoogleProjectHosting

20160629

914 23


CSundergrad,CV,DL,ML
285
deeplearningcuttingedgetopicMOOC
GitHubsindresorhus/awesome:Acuratedlistofawesome
listsdeeplearningGitHubChristosChristofidis/awesomedeeplearning:Acurated
listofawesomeDeepLearningtutorials,projectsandcommunities.

Courses,VideosandLecturesTutorials

sections
listdeeplearningroadmap~

AwesomeDeepLearning
TableofContents

FreeOnlineBooks

Courses

VideosandLectures

Papers

Tutorials

Researchers

WebSites

Datasets

Frameworks

Miscellaneous

Contributing

FreeOnlineBooks

1.DeepLearningbyYoshuaBengio,IanGoodfellowandAaronCourville(05/07/2015)
2.NeuralNetworksandDeepLearningbyMichaelNielsen(Dec2014)
3.DeepLearningbyMicrosoftResearch(2013)
4.DeepLearningTutorialbyLISAlab,UniversityofMontreal(Jan62015)
5.neuraltalkbyAndrejKarpathy:numpybasedRNN/LSTMimplementation
6.Anintroductiontogeneticalgorithms
7.ArtificialIntelligence:AModernApproach
8.DeepLearninginNeuralNetworks:AnOverview

GitHubChristosChristofidis/awesomedeeplearning:AcuratedlistofawesomeDeepLearning
tutorials,projectsandcommunities.

Courses

1.MachineLearningStanfordbyAndrewNginCoursera(20102014)
2.MachineLearningCaltechbyYaserAbuMostafa(20122014)
3.MachineLearningCarnegieMellonbyTomMitchell(Spring2011)
4.NeuralNetworksforMachineLearningbyGeoffreyHintoninCoursera(2012)
5.NeuralnetworksclassbyHugoLarochellefromUniversitdeSherbrooke(2013)
6.DeepLearningCoursebyCILVRlab@NYU(2014)
7.A.IBerkeleybyDanKleinandPieterAbbeel(2013)
8.A.IMITbyPatrickHenryWinston(2010)

9.VisionandlearningcomputersandbrainsbyShimonUllman,TomasoPoggio,EthanMeyers
@MIT(2013)
10.ConvolutionalNeuralNetworksforVisualRecognitionStanfordbyFeiFeiLi,AndrejKarpathy
(2015)
11.ConvolutionalNeuralNetworksforVisualRecognitionStanfordbyFeiFeiLi,AndrejKarpathy
(2016)
12.DeepLearningforNaturalLanguageProcessingStanford
13.NeuralNetworksusherbrooke
14.MachineLearningOxford(20142015)
15.DeepLearningNvidia(2015)
16.GraduateSummerSchool:DeepLearning,FeatureLearningbyGeoffreyHinton,Yoshua
Bengio,YannLeCun,AndrewNg,NandodeFreitasandseveralothers@IPAM,UCLA(2012)
17.DeepLearningUdacity/GooglebyVincentVanhouckeandArpanChakraborty(2016)
18.DeepLearningUWaterloobyProf.AliGhodsiatUniversityofWaterloo(2015)

VideosandLectures

1.HowToCreateAMindByRayKurzweil
2.DeepLearning,SelfTaughtLearningandUnsupervisedFeatureLearningByAndrewNg
3.RecentDevelopmentsinDeepLearningByGeoffHinton
4.TheUnreasonableEffectivenessofDeepLearningbyYannLeCun
5.DeepLearningofRepresentationsbyYoshuabengio
6.PrinciplesofHierarchicalTemporalMemorybyJeffHawkins
7.MachineLearningDiscussionGroupDeepLearningw/StanfordAILabbyAdamCoates
8.MakingSenseoftheWorldwithDeepLearningByAdamCoates
9.DemystifyingUnsupervisedFeatureLearningByAdamCoates
10.VisualPerceptionwithDeepLearningByYannLeCun
11.TheNextGenerationofNeuralNetworksByGeoffreyHintonatGoogleTechTalks
12.ThewonderfulandterrifyingimplicationsofcomputersthatcanlearnByJeremyHowardat
TEDxBrussels
13.UnsupervisedDeepLearningStanfordbyAndrewNginStanford(2011)
14.NaturalLanguageProcessingByChrisManninginStanford
15.AbeginnersGuidetoDeepNeuralNetworksByNatalieHammelandLorraineYurshansky
16.DeepLearning:IntelligencefromBigDatabySteveJurvetson(andpanel)atVLABinStanford.

Papers

1.ImageNetClassificationwithDeepConvolutionalNeuralNetworks
2.UsingVeryDeepAutoencodersforContentBasedImageRetrieval
3.LearningDeepArchitecturesforAI
4.CMUslistofpapers
5.NeuralNetworksforNamedEntityRecognitionzip
6.TrainingtricksbyYB
7.GeoffHinton'sreadinglist(allpapers)
8.SupervisedSequenceLabellingwithRecurrentNeuralNetworks
9.StatisticalLanguageModelsbasedonNeuralNetworks
10.TrainingRecurrentNeuralNetworks
11.RecursiveDeepLearningforNaturalLanguageProcessingandComputerVision
12.BidirectionalRNN
13.LSTM
14.GRUGatedRecurrentUnit
15.GFRNN..
16.LSTM:ASearchSpaceOdyssey
17.ACriticalReviewofRecurrentNeuralNetworksforSequenceLearning
18.VisualizingandUnderstandingRecurrentNetworks
19.WojciechZaremba,IlyaSutskever,AnEmpiricalExplorationofRecurrentNetwork
Architectures
20.RecurrentNeuralNetworkbasedLanguageModel

21.ExtensionsofRecurrentNeuralNetworkLanguageModel
22.RecurrentNeuralNetworkbasedLanguageModelinginMeetingRecognition
23.DeepNeuralNetworksforAcousticModelinginSpeechRecognition
24.SpeechRecognitionwithDeepRecurrentNeuralNetworks
25.ReinforcementLearningNeuralTuringMachines
26.LearningPhraseRepresentationsusingRNNEncoderDecoderforStatisticalMachine
Translation
27.GoogleSequencetoSequenceLearningwithNneuralNetworks
28.MemoryNetworks
29.PolicyLearningwithContinuousMemoryStatesforPartiallyObservedRoboticControl
30.MicrosoftJointlyModelingEmbeddingandTranslationtoBridgeVideoandLanguage
31.NeuralTuringMachines
32.AskMeAnything:DynamicMemoryNetworksforNaturalLanguageProcessing
33.MasteringtheGameofGowithDeepNeuralNetworksandTreeSearch

Tutorials

1.UFLDLTutorial1
2.UFLDLTutorial2
3.DeepLearningforNLP(withoutMagic)
4.ADeepLearningTutorial:FromPerceptronstoDeepNetworks
5.DeepLearningfromtheBottomup
6.TheanoTutorial
7.NeuralNetworksforMatlab
8.Usingconvolutionalneuralnetstodetectfacialkeypointstutorial
9.Torch7Tutorials
10.TheBestMachineLearningTutorialsOnTheWeb
11.VGGConvolutionalNeuralNetworksPractical
12.TensorFlowtutorials
13.MoreTensorFlowtutorials
14.TensorFlowPythonNotebooks
15.KerasandLasagneDeepLearningTutorials

Researchers

1.AaronCourville
2.AbdelrahmanMohamed
3.AdamCoates
4.AlexAcero
5.AlexKrizhevsky
6.AlexanderIlin
7.AmosStorkey
8.AndrejKarpathy
9.AndrewM.Saxe
10.AndrewNg
11.AndrewW.Senior
12.AndriyMnih
13.AyseNazErkan
14.BenjaminSchrauwen
15.BernardeteRibeiro
16.BoDavidChen
17.BoureauYLan
18.BrianKingsbury
19.ChristopherManning
20.ClementFarabet
21.DanClaudiuCirean
22.DavidReichert
23.DerekRose

24.DongYu
25.DrausinWulsin
26.ErikM.Schmidt
27.EugenioCulurciello
28.FrankSeide
29.GalenAndrew
30.GeoffreyHinton
31.GeorgeDahl
32.GrahamTaylor
33.GrgoireMontavon
34.GuidoFranciscoMontfar
35.GuillaumeDesjardins
36.HannesSchulz
37.HlnePaugamMoisy
38.HonglakLee
39.HugoLarochelle
40.IlyaSutskever
41.ItamarArel
42.JamesMartens
43.JasonMorton
44.JasonWeston
45.JeffDean
46.JiquanMgiam
47.JosephTurian
48.JoshuaMatthewSusskind
49.JrgenSchmidhuber
50.JustinA.Blanco
51.KorayKavukcuoglu
52.KyungHyunCho
53.LiDeng
54.LucasTheis
55.LudovicArnold
56.Marc'AurelioRanzato
57.MartinLngkvist
58.MishaDenil
59.MohammadNorouzi
60.NandodeFreitas
61.NavdeepJaitly
62.NicolasLeRoux
63.NitishSrivastava
64.NoelLopes
65.OriolVinyals
66.PascalVincent
67.PatrickNguyen
68.PedroDomingos
69.PeggySeries
70.PierreSermanet
71.PiotrMirowski
72.QuocV.Le
73.ReinholdScherer
74.RichardSocher
75.RobFergus
76.RobertCoop
77.RobertGens
78.RogerGrosse
79.RonanCollobert
80.RuslanSalakhutdinov
81.SebastianGerwinn

82.StphaneMallat
83.SvenBehnke
84.TapaniRaiko
85.TaraSainath
86.TijmenTieleman
87.TomKarnowski
88.TomMikolov
89.UeliMeier
90.VincentVanhoucke
91.VolodymyrMnih
92.YannLeCun
93.YichuanTang
94.YoshuaBengio
95.YotaroKubo
96.Youzhi(Will)Zou

WebSites

1.deeplearning.net
2.deeplearning.stanford.edu
3.nlp.stanford.edu
4.aijunkie.com
5.cs.brown.edu/research/ai
6.eecs.umich.edu/ai
7.cs.utexas.edu/users/ailab
8.cs.washington.edu/research/ai
9.aiai.ed.ac.uk
10.wwwaig.jpl.nasa.gov
11.csail.mit.edu
12.cgi.cse.unsw.edu.au/~aishare
13.cs.rochester.edu/research/ai
14.ai.sri.com
15.isi.edu/AI/isd.htm
16.nrl.navy.mil/itd/aic
17.hips.seas.harvard.edu
18.AIWeekly
19.stat.ucla.edu
20.deeplearning.cs.toronto.edu
21.jeffdonahue.com/lrcn/
22.visualqa.org
23.www.mpiinf.mpg.de/departments/computervision...
24.DeepLearningNews

Datasets

1.MNISTHandwrittendigits
2.GoogleHouseNumbersfromstreetview
3.CIFAR10andCIFAR1004.
4.IMAGENET
5.TinyImages80Milliontinyimages6.
6.FlickrData100MillionYahoodataset
7.BerkeleySegmentationDataset500
8.UCIrvineMachineLearningRepository
9.Flickr8k
10.Flickr30k
11.MicrosoftCOCO
12.VQA
13.ImageQA

14.AT&TLaboratoriesCambridgefacedatabase
15.AVHRRPathfinder
16.AirFreightTheAirFreightdatasetisaraytracedimagesequencealongwithgroundtruth
segmentationbasedontexturalcharacteristics.(455images+GT,each160x120pixels).
(Formats:PNG)
17.AmsterdamLibraryofObjectImagesALOIisacolorimagecollectionofonethousandsmall
objects,recordedforscientificpurposes.Inordertocapturethesensoryvariationinobject
recordings,wesystematicallyvariedviewingangle,illuminationangle,andilluminationcolorfor
eachobject,andadditionallycapturedwidebaselinestereoimages.Werecordedovera
hundredimagesofeachobject,yieldingatotalof110,250imagesforthecollection.(Formats:
png)
18.Annotatedface,hand,cardiac&meatimagesMostimages&annotationsaresupplemented
byvariousASM/AAManalysesusingtheAAMAPI.(Formats:bmp,asf)
19.ImageAnalysisandComputerGraphics
20.BrownUniversityStimuliAvarietyofdatasetsincludinggeons,objects,and"greebles".Good
fortestingrecognitionalgorithms.(Formats:pict)
21.CAVIARvideosequencesofmallandpublicspacebehavior90Kvideoframesin90
sequencesofvarioushumanactivities,withXMLgroundtruthofdetectionandbehavior
classification(Formats:MPEG2&JPEG)
22.MachineVisionUnit
23.CCITTFaxstandardimages8images(Formats:gif)
24.CMUCIL'sStereoDatawithGroundTruth3setsof11images,includingcolortiffimageswith
spectroradiometry(Formats:gif,tiff)
25.CMUPIEDatabaseAdatabaseof41,368faceimagesof68peoplecapturedunder13poses,
43illuminationsconditions,andwith4differentexpressions.
26.CMUVASCImageDatabaseImages,sequences,stereopairs(thousandsofimages)
(Formats:SunRasterimage)
27.CaltechImageDatabaseabout20imagesmostlytopdownviewsofsmallobjectsandtoys.
(Formats:GIF)
28.ColumbiaUtrechtReflectanceandTextureDatabaseTextureandreflectancemeasurements
forover60samplesof3Dtexture,observedwithover200differentcombinationsofviewingand
illuminationdirections.(Formats:bmp)
29.ComputationalColourConstancyDataAdatasetorientedtowardscomputationalcolor
constancy,butusefulforcomputervisioningeneral.Itincludessyntheticdata,camerasensor
data,andover700images.(Formats:tiff)
30.ComputationalVisionLab
31.Contentbasedimageretrievaldatabase11setsofcolorimagesfortestingalgorithmsfor
contentbasedretrieval.Mostsetshaveadescriptionfilewithnamesofobjectsineachimage.
(Formats:jpg)
32.EfficientContentbasedRetrievalGroup
33.DenselySampledViewSpheresDenselysampledviewspheresupperhalfoftheview
sphereoftwotoyobjectswith2500imageseach.(Formats:tiff)
34.ComputerScienceVII(GraphicalSystems)
35.DigitalEmbryosDigitalembryosarenovelobjectswhichmaybeusedtodevelopandtest
objectrecognitionsystems.Theyhaveanorganicappearance.(Formats:variousformatsare
availableonrequest)
36.UniverityofMinnesotaVisionLab
37.ElSalvadorAtlasofGastrointestinalVideoEndoscopyImagesandVideosofhisresofstudies
takenfromGastrointestinalVideoendoscopy.(Formats:jpg,mpg,gif)
38.FGNETFacialAgingDatabaseDatabasecontains1002faceimagesshowingsubjectsat
differentages.(Formats:jpg)
39.FVC2000FingerprintDatabasesFVC2000istheFirstInternationalCompetitionforFingerprint
VerificationAlgorithms.FourfingerprintdatabasesconstitutetheFVC2000benchmark(3520
fingerprintsinall).
40.BiometricSystemsLabUniversityofBologna
41.FaceandGestureimagesandimagesequencesSeveralimagedatasetsoffacesand
gesturesthataregroundtruthannotatedforbenchmarking
42.GermanFingerspellingDatabaseThedatabasecontains35gesturesandconsistsof1400

imagesequencesthatcontaingesturesof20differentpersonsrecordedundernonuniform
daylightlightingconditions.(Formats:mpg,jpg)
43.LanguageProcessingandPatternRecognition
44.GroningenNaturalImageDatabase4000+1536x1024(16bit)calibratedoutdoorimages
(Formats:homebrew)
45.ICGTesthousesequence2turntablesequencesfromifferentviewingheights,36images
each,resolution1000x750,color(Formats:PPM)
46.InstituteofComputerGraphicsandVision
47.IENImageLibrary1000+images,mostlyoutdoorsequences(Formats:raw,ppm)
48.INRIA'sSyntimimagesdatabase15colorimageofsimpleobjects(Formats:gif)
49.INRIA
50.INRIA'sSyntimstereodatabases34calibratedcolorstereopairs(Formats:gif)
51.ImageAnalysisLaboratoryImagesobtainedfromavarietyofimagingmodalitiesrawCFA
images,rangeimagesandahostof"medicalimages".(Formats:homebrew)
52.ImageAnalysisLaboratory
53.ImageDatabaseAnimagedatabaseincludingsometextures
54.JAFFEFacialExpressionImageDatabaseTheJAFFEdatabaseconsistsof213imagesof
Japanesefemalesubjectsposing6basicfacialexpressionsaswellasaneutralpose.Ratings
onemotionadjectivesarealsoavailable,freeofcharge,forresearchpurposes.(Formats:TIFF
Grayscaleimages.)
55.ATRResearch,Kyoto,Japan
56.JISCTStereoEvaluation44imagepairs.Thesedatahavebeenusedinanevaluationof
stereoanalysis,asdescribedintheApril1993ARPAImageUnderstandingWorkshoppaper
``TheJISCTStereoEvaluation''byR.C.Bolles,H.H.Baker,andM.J.Hannah,263274
(Formats:SSI)
57.MITVisionTextureImagearchive(100+images)(Formats:ppm)
58.MITfaceimagesandmorehundredsofimages(Formats:homebrew)
59.MachineVisionImagesfromthetextbookbyJain,Kasturi,Schunck(20+images)(Formats:
GIFTIFF)
60.MammographyImageDatabases100ormoreimagesofmammogramswithgroundtruth.
Additionalimagesavailablebyrequest,andlinkstoseveralothermammographydatabasesare
provided.(Formats:homebrew)
61.ftp.cps.msu.edu/pub/pri...manyimages(Formats:unknown)
62.MiddleburyStereoDataSetswithGroundTruthSixmultiframestereodatasetsofscenes
containingplanarregions.Eachdatasetcontains9colorimagesandsubpixelaccuracy
groundtruthdata.(Formats:ppm)
63.MiddleburyStereoVisionResearchPageMiddleburyCollege
64.ModisAirbornesimulator,GalleryanddatasetHighAltitudeImageryfromaroundtheworldfor
environmentalmodelinginsupportofNASAEOSprogram(Formats:JPGandHDF)
65.NISTFingerprintandhandwritingdatasetsthousandsofimages(Formats:unknown)
66.NISTFingerprintdatacompressedmultipartuuencodedtarfile
67.NLMHyperDocVisibleHumanProjectColor,CATandMRIimagesamplesover30images
(Formats:jpeg)
68.NationalDesignRepositoryOver55,0003DCADandsolidmodelsof(mostly)
mechanical/machinedengineerigndesigns.(Formats:gif,vrml,wrl,stp,sat)
69.Geometric&IntelligentComputingLaboratory
70.OSU(MSU)3DObjectModelDatabaseseveralsetsof3Dobjectmodelscollectedover
severalyearstouseinobjectrecognitionresearch(Formats:homebrew,vrml)
71.OSU(MSU/WSU)RangeImageDatabaseHundredsofrealandsyntheticimages(Formats:
gif,homebrew)
72.OSU/SAMPLDatabase:RangeImages,3DModels,Stills,MotionSequencesOver1000
rangeimages,3Dobjectmodels,stillimagesandmotionsequences(Formats:gif,ppm,vrml,
homebrew)
73.SignalAnalysisandMachinePerceptionLaboratory
74.OtagoOpticalFlowEvaluationSequencesSyntheticandrealsequenceswithmachine
readablegroundtruthopticalflowfields,plustoolstogenerategroundtruthfornewsequences.
(Formats:ppm,tif,homebrew)
75.VisionResearchGroup

76.ftp.limsi.fr/pub/quenot...RealandsyntheticimagesequencesusedfortestingaParticleImage
Velocimetryapplication.Theseimagesmaybeusedforthetestofopticalflowandimage
matchingalgorithms.(Formats:pgm(raw))
77.LIMSICNRS/CHM/IMM/vision
78.LIMSICNRS
79.Photometric3DSurfaceTextureDatabaseThisisthefirst3Dtexturedatabasewhichprovides
bothfullrealsurfacerotationsandregisteredphotometricstereodata(30textures,1680
images).(Formats:TIFF)
80.SEQUENCESFOROPTICALFLOWANALYSIS(SOFA)9syntheticsequencesdesignedfor
testingmotionanalysisapplications,includingfullgroundtruthofmotionandcamera
parameters.(Formats:gif)
81.ComputerVisionGroup
82.SequencesforFlowBasedReconstructionsyntheticsequencefortestingstructurefrom
motionalgorithms(Formats:pgm)
83.StereoImageswithGroundTruthDisparityandOcclusionasmallsetofsyntheticimagesofa
hallwaywithvaryingamountsofnoiseadded.Usetheseimagestobenchmarkyourstereo
algorithm.(Formats:raw,viff(khoros),ortiff)
84.StuttgartRangeImageDatabaseAcollectionofsyntheticrangeimagestakenfromhigh
resolutionpolygonalmodelsavailableontheweb(Formats:homebrew)
85.DepartmentImageUnderstanding
86.TheARFaceDatabaseContainsover4,000colorimagescorrespondingto126people's
faces(70menand56women).Frontalviewswithvariationsinfacialexpressions,illumination,
andocclusions.(Formats:RAW(RGB24bit))
87.PurdueRobotVisionLab
88.TheMITCSAILDatabaseofObjectsandScenesDatabasefortestingmulticlassobject
detectionandscenerecognitionalgorithms.Over72,000imageswith2873annotatedframes.
Morethan50annotatedobjectclasses.(Formats:jpg)
89.TheRVLSPECDB(SPECularityDataBase)Acollectionofover300realimagesof100
objectstakenunderthreedifferentilluminaitonconditions(Diffuse/Ambient/Directed).Use
theseimagestotestalgorithmsfordetectingandcompensatingspecularhighlightsincolor
images.(Formats:TIFF)
90.RobotVisionLaboratory
91.TheXm2vtsdatabaseTheXM2VTSDBcontainsfourdigitalrecordingsof295peopletaken
overaperiodoffourmonths.Thisdatabasecontainsbothimageandvideodataoffaces.
92.CentreforVision,SpeechandSignalProcessing
93.TrafficImageSequencesand'MarbledBlock'Sequencethousandsofframesofdigitizedtraffic
imagesequencesaswellasthe'MarbledBlock'sequence(grayscaleimages)(Formats:GIF)
94.IAKS/KOGS
95.UBernFaceimageshundredsofimages(Formats:Sunrasterfile)
96.UMichigantextures(Formats:compressedraw)
97.UOuluwoodandknotsdatabaseIncludesclassifications1000+colorimages(Formats:
ppm)
98.UCIDanUncompressedColourImageDatabaseabenchmarkdatabaseforimageretrieval
withpredefinedgroundtruth.(Formats:tiff)
99.UMassVisionImageArchiveLargeimagedatabasewithaerial,space,stereo,medicalimages
andmore.(Formats:homebrew)
100.UNC's3Dimagedatabasemanyimages(Formats:GIF)
101.USFRangeImageDatawithSegmentationGroundTruth80imagesets(Formats:Sun
rasterimage)
102.UniversityofOuluPhysicsbasedFaceDatabasecontainscolorimagesoffacesunder
differentilluminantsandcameracalibrationconditionsaswellasskinspectralreflectance
measurementsofeachperson.
103.MachineVisionandMediaProcessingUnit
104.UniversityofOuluTextureDatabaseDatabaseof320surfacetextures,eachcapturedunder
threeilluminants,sixspatialresolutionsandninerotationangles.Asetoftestsuitesisalso
providedsothattexturesegmentation,classification,andretrievalalgorithmscanbetestedina
standardmanner.(Formats:bmp,ras,xv)
105.MachineVisionGroup

106.UsenixfacedatabaseThousandsoffaceimagesfrommanydifferentsites(circa994)
107.ViewSphereDatabaseImagesof8objectsseenfrommanydifferentviewpoints.Theview
sphereissampledusingageodesicwith172images/sphere.Twosetsfortrainingandtesting
areavailable.(Formats:ppm)
108.PRIMA,GRAVIR
109.VisionlistImageryArchiveManyimages,manyformats
110.WiryObjectRecognitionDatabaseThousandsofimagesofacart,ladder,stool,bicycle,
chairs,andclutteredsceneswithgroundtruthlabelingsofedgesandregions.(Formats:jpg)
111.3DVisionGroup
112.YaleFaceDatabase165images(15individuals)withdifferentlighting,expression,and
occlusionconfigurations.
113.YaleFaceDatabaseB5760singlelightsourceimagesof10subjectseachseenunder576
viewingconditions(9posesx64illuminationconditions).(Formats:PGM)
114.CenterforComputationalVisionandControl

Frameworks

1.Caffe
2.Torch7
3.Theano
4.cudaconvnet
5.convetjs
6.Ccv
7.NuPIC
8.DeepLearning4J
9.Brain
10.DeepLearnToolbox
11.Deepnet
12.Deeppy
13.JavaNN
14.hebel
15.Mocha.jl
16.OpenDL
17.cuDNN
18.MGL
19.KUnet.jl
20.NvidiaDIGITSawebappbasedonCaffe
21.NeonPythonbasedDeepLearningFramework
22.KerasTheanobasedDeepLearningLibrary
23.ChainerAflexibleframeworkofneuralnetworksfordeeplearning
24.RNNLMToolkit
25.RNNLIBArecurrentneuralnetworklibrary
26.charrnn
27.MatConvNet:CNNsforMATLAB
28.MinervaafastandflexibletoolfordeeplearningonmultiGPU
29.BrainstormFast,flexibleandfunneuralnetworks.
30.TensorflowOpensourcesoftwarelibraryfornumericalcomputationusingdataflowgraphs
31.DMTKMicrosoftDistributedMachineLearningTookit
32.ScikitFlowSimplifiedinterfaceforTensorFlow(mimickingScikitLearn)
33.MXnetLightweight,Portable,FlexibleDistributed/MobileDeepLearningframework
34.VelesSamsungDistributedmachinelearningplatform
35.MarvinAMinimalistGPUonlyNDimensionalConvNetsFramework
36.ApacheSINGAAGeneralDistributedDeepLearningPlatform
37.DSSTNEAmazon'slibraryforbuildingDeepLearningmodels
38.SyntaxNetGoogle'ssyntacticparserATensorFlowdependencylibrary

Miscellaneous

1.GooglePlusDeepLearningCommunity
2.CaffeWebinar
3.100BestGithubResourcesinGithubforDL
4.Word2Vec
5.CaffeDockerFile
6.TorontoDeepLEarningconvnet
7.gfx.js
8.Torch7Cheatsheet
9.MiscfromMIT's'AdvancedNaturalLanguageProcessing'course
10.MiscfromMIT's'MachineLearning'course
11.MiscfromMIT's'NetworksforLearning:RegressionandClassification'course
12.MiscfromMIT's'NeuralCodingandPerceptionofSound'course
13.ImplementingaDistributedDeepLearningNetworkoverSpark
14.AchessAIthatlearnstoplaychessusingdeeplearning.
15.Reproducingtheresultsof"PlayingAtariwithDeepReinforcementLearning"byDeepMind
16.Wiki2Vec.GettingWord2vecvectorsforentitiesandwordfromWikipediaDumps
17.TheoriginalcodefromtheDeepMindarticle+tweaks
18.GoogledeepdreamNeuralNetworkart
19.Anefficient,batchedLSTM.
20.Arecurrentneuralnetworkdesignedtogenerateclassicalmusic.
21.MemoryNetworksImplementationsFacebook
22.FacerecognitionwithGoogle'sFaceNetdeepneuralnetwork.
23.Basicdigitrecognitionneuralnetwork
24.EmotionRecognitionAPIDemoMicrosoft
25.ProofofconceptforloadingCaffemodelsinTensorFlow
26.YOLO:RealTimeObjectDetection
27.AlphaGoAreplicationofDeepMind's2016Naturepublication,"MasteringthegameofGowith
deepneuralnetworksandtreesearch"

20160521

285 16

429

TensorLayerDLRL
GoogleTensorFlow

WelcometoTensorLayer
GithubGitHubzsdonghao/tensorlayer:TensorLayer:DeepLearningand
ReinforcementLearningLibraryforTensorFlow.

TensorLayer
Github:GitHubshorxp/tensorlayerchinese:TensorLayer

==================
TensorLayerTfslim
googlepretrainedmodelTensorLayer

CNNAPILayersTFRecordpython
threadingImageSegmentationNLP

ExampleTensorLayer1.2.5documentation

====================================================================
ReinforcementLearning:
RLTutorialTensorLayer1.1documentation
tensorlayer/tutorial_atari_pong.pyatmasterzsdonghao/tensorlayerGitHub

DenoisingAutoencoder:
DAETutorialTensorLayer1.1documentation
tensorlayer/tutorial_mnist.pyatmasterzsdonghao/tensorlayerGitHub

ConvolutionalNeuralNetwork:
CNNTutorialTensorLayer1.1documentation
1.tensorlayer/tutorial_mnist.pyatmasterzsdonghao/tensorlayerGitHub
2.tensorlayer/tutorial_cifar10_tfrecord.pyatmasterzsdonghao/tensorlayerGitHub
tfrecorddataaugmentation

LSTM:
LSTMtensorlayer.readthedocs.io...
github.com

WordEmbeddingWord2vec:
Word2vecTutorialTensorLayer1.1documentation
tensorlayer/tutorial_word2vec_basic.pyatmasterzsdonghao/tensorlayer
GitHub

MachineTranslationSeq2seq:
Seq2seqTutorialTensorLayer1.1documentation
github.com

ImageCaptioningzsdonghao/ImageCaptioning

GANzsdonghao/dcgan

20161117

429 32


AlgorithmEngineer@iDST,Alibaba

281
(?)17.04.14

DeepLearningNeuralNetwork
AutoEncoderAutoEncoder
AutoEncoderpretrainingAEpretraining

pretraining10pretrainingdropoutReLU
AdamRMSProp

DeepLearning

DNNCNNRNNNLP

CNNCNN
/CNN
LeNetMinst

CNNAlexNetGoogleNetResNetpretraining+
finetuningpaper
RNNNeuralNetworkLanguageModel

CNNRNN

CNNRNN
StackDeepCNNlongdependencyRNN
RNNcellendtoendSequencetoSequence

DeepLearning

CaffeDeepLearningCNNC++BasedCode
CaffeInference

Theano
MXNet
TensorflowLanguageModelonPTBDataset
MXNet
TensorflowTensorslow1.0API
KerasgRPC

Keras
PyTorch
2PyTorch
Caffe
CaffeTF

TheanoMXNetPyTorch
CMUDyNet2.5

TFXLA
FPGATPUGoogle

GPUGPUCPU

GANNeuralTuringMachineDeepBayesianNetwork

20170414

281 24


nothingyeteverything

59
feedforward
neuralnetworkbpstanforddl
cnnrnnlstm

20160104

59 8



109
2017.04.15

cs231Nfast.ai

exacity/deeplearningbookchinese

keras

..........................................

2017.04.12

courserahost



mooccoursera

1._35_
2.()


3.(),high

1.(NTUOpenCourseWare)

2.()

3.()

1.()
2.coursera

1.courseracs231
2.courseracourseramooc
.....mooc
()
3.udacitysklearn,tensorflow
google././.
4.(),()

1.courserajavajava
().mooc
2.(OpenCourseWare,OCW),
()

cuda

1.GPU


1.
ImageandVideoProcessing:FromMars
toHollywoodwithaStopattheHospitalDukeUniversity|Coursera

1.
LearningHowtoLearnUniversityofCalifornia,SanDiego|
Coursera

612579039

20170415

109 27

YJango

325

Deep
Deep
YJangoLive

TensorFlow
TensorflowLV1(gitbookLV1)
Tensorflow2
Tensorflow
Recurrent
LSTM
scanLSTM
LSTM&ampampGRU

Deep








1
2

20170401
325 20


ScientistAIEngineer
40
YoshuaBengio(NN)DeepLearningDeep
LearningDLDL

StanfordConvolutionNeuralNetworksforVisualRecognition
CS231nConvolutionalNeuralNetworksforVisualRecognitionCNN
CNNNeural
NetworksDLDL
DeepLearning

CourseraDeepLearninghttps://www.coursera.org/learn/neuralnetworks
(NeuralNetworksforMachineLearning)GeoffreyHinton(NN)

20161205

40 1

32

()+()+

20170414

32 13

wgwang

267

1.

LinearAlgebra()
()

2.

()()

3.

()(
)

2015Google

trainingvalidationtesting

svmnnkmeansmcmcsgd

PatternRecognitionAndMachineLearning()
UFLDLUfldl

1.trainingvalidationtesting

2.classificationregression

3.SVM

4.clusterkmeans

5.

GPU
C/C++Pythonjavalua
PHP
()
CC++C()C++Primer5(
)Learning
Python()SciPyandNumPy()Python
cudaGPUhttps://developer.nvidia.com/cudazone

201HintonBengioLeCun

highwikipediadlDeeplearning
LeCunBengioHintonNatureReviewDeep
learningcs.toronto.edu/~hinton/...BengioLearningDeep
ArchitecturesforAIsanghv.com/download/sof...SchmidhuberDeepLearninginNeural
NetworksAnOverviewarxiv.org/pdf/1404.7828...

youtube.com/channel/UC9...+youtube.com/playlist?...

ImageNetClassificationwithDeepConvolutionalNeuralNetworkspapers.nips.cc/paper/48...
dl
word2vecpapers.nips.cc/paper/50...nlp
alphaGoMasteringthegameofGowithdeepneuralnetworksandtreesearch
willamette.edu/~levenic...

0
work
GitHubBVLC/caffe:Caffe:afastopen
frameworkfordeeplearning.GitHubtensorflow/tensorflow:Computationusingdataflowgraphs
forscalablemachinelearningGitHubTheano/Theano:TheanoisaPythonlibrarythatallowsyou
todefine,optimize,andevaluatemathematicalexpressionsinvolvingmultidimensionalarrays
efficiently.ItcanuseGPUsandperformefficientsymbolicdifferentiation.GitHubtorch/torch7:
http://torch.chjeff
deanyoutube.com/watch?...TensorFlowt
AlphaGotersorflow

alphagoajahuang6

20160318

267 25


la
180
2017

Orz

DL

CV
EE

0AndrewNg()
:MachineLearning
()

1.UFLDL:ufldl.stanford.edu/wiki...

NeuralNetworks

BackpropagationAlgorithm

2.CMU
AdvancedIntroductiontoMachineLearningPPT:
cs.cmu.edu/~epxing/Clas...

Machine
LearningCNN

3.CAFFE:
Caffe|CaffeTutorial

CAFFEdeep
learningdeep
learningtutorial

DLCNN
>>>>BP>>CNN
DL:
Hubel&Wiesel>()>
>>>&

20170204

180 11

162


:
paperweekly
scir




AI

ArxivArxiv
Arxiv
arxiv.org/help/subscrib...
NLPPython
MemoryConnected
PaperGoogle
,
GeoffreyHinton
YannLeCun
YoshuaBengio
AndrejKarpathy
andrewYng
RichardSocher
TomasMikolov
OriolVinyals
PercyLiang
JasonWeston
HangLi
TieYanLiu




PaperWeekly


rsarxiv.github.ioDeepLearninginNLP
nlp.hivefire.comNLP
github.com/dennybritz/d...GoogleBrain
reddit.com/r/MachineLea...,Reddit

PaperWeekly:zhangjun168305,

Twitter,

20170118

162 4

232
ADeepLearningTutorial:FromPerceptronstoAlgorithms
BPPRML345
Matlab
rasmusbergpalm/DeepLearnToolboxGitHub
DEEPLEARNINGUFLDLUnsupervisedFeatureLearning
andDeepLearningTutorial

20141019

232 11

22
CNNslides
StanfordUniversityCS231n:ConvolutionalNeuralNetworksforVisualRecognition

20150613

22 8