67

So you can integrate with the rest of the code base. It seems your company uses a mix of Java and python. What are you going to do if a little corner of the site needs machine learning; pass the data around with a database, or a cache, drop to R, and so on? Why not just do it all in the same language? It's faster, cleaner, and easier to maintain. Know any ...


24

There may be a lot of reasons like: Workforce flexibility: One Java / Python programmers can be moved to other tasks or projects easily. Candidates availability: there are plenty of Java / Python programmers. You do not want to introduce a new programming language to later find out that there are no qualified workers or they are just too expensive. ...


21

Introductory: Machine Learning: The Art and Science of Algorithms that Make Sense of Data (Flach) Learning From Data (Abu-Mostafa et al.) Introduction to Statistical Learning (James et al.) Digging deeper: Elements of Statistical Learning (Hastie et al.) Pattern Recognition and Machine Learning (Bishop) Some special interest examples: Convex ...


14

It is in general true that for purely data science and statistics exercises R offers the best and fastest (especially if using the data.table package) tools and methods, that otherwise would be heavier to implement in Python (I assume by Python we all mean Pandas, though). Most data scientists do in fact use R to perform their models and calculations, or ...


13

If I could only recomend one to you, it would be: The Elements of Statistical Learning and Prediction by Hastie, Tibshirani and Friedman. It provides the math/statistics behind a lot of commonly used techniques in data science. For Bayesian Techniques, Bayesian Data Analysis by Gelman, Carlin, Stern, Dunson, Vehtari and Rubin is excellent. Statistical ...


12

I strongly suggest Talking Machines. It's a very well put together podcast from a professor at Harvard. They cater to both machine learning experts and enthusiasts. Their interviews are often done from NIPS, and the guests are usually top tier practitioners.


11

Start with the Coursera's Machine Learning course. It does a really good job in introducing the student to the domain of Machine Learning and helps you lay a solid foundation in the concepts. In case, you feel that the math is a bit dumbed down in that course, you can take this course, taught by the same professor and is more math-intensive than the former. ...


8

Most of the "standard textbooks" (e.g., Goldberg, Mitchell, etc.) are pretty dated now. If you just want to have some confidence that you understand how the basic algorithms work, they're fine, but they tend to emphasize material that's doesn't necessarily match the more modern way of understanding and talking about things like theoretical issues. I've used ...


8

Based on my experience, not just for ImageNet, if you have enough data it's better to train your network from scratch. There are numerous reasons that I can explain why. First of all, I don't know whether you have had this experience or not but I've trained complicated CNNs neworks with over 25 million parameters. After reaching 95% accuracy, after ...


8

Data science jobs cover a wide range of different activities so any answer is likely to be subjective. I'm in academia so my knowledge of the job market is limited, but from what I can see: The current context is very favorable to data scientists looking for a job, so anybody with some basic knowledge of ML has a chance. You're already above this level so ...


7

I like Amir Ali Akbari's suggestions, and I'll add a few of my own, focusing on topics and skills that are not adequately covered in most machine learning and data analysis books that focus on math and/or programming. Data Cleaning: Osborne 2012, Best Practices in Data Cleaning McCallom 2012, Bad Data Handbook: Cleaning Up The Data So You Can Get Back To ...


7

Other answers recommended a good set of books about the mathematics behind data science. But as you mentioned, its not just mathematics and activities like data collection and inference from data has their own rules and theories, even if not being as rigorous as mathematical backgrounds (yet). For theses parts, I suggest the book Beautiful Data: The Stories ...


7

I've seen quite a few companies using the title Data Scientist for "Data Engineer" type roles. Particularly in the big data space. If the company is using Hadoop or a distributed framework like Spark to do it's analytics in then Java or Python (or probably Scala) would be the languages that would make the most sense .


7

Although you need book, I recommend the following courses respectively for understanding statistics which are used for machine learning and other tasks in data science. They are free. Learn Statistics - Intro to Statistics Course Intro to Descriptive Statistics Inferential Statistics: Learn Statistical Analysis If I want to recommend a book, I would ...


6

In Data Skeptic they talk about different aspects of data science: Data Skeptic is a podcast that alternates between short mini episodes with the host explaining concepts from data science to his non-data scientist wife, and longer interviews featuring practitioners and experts on interesting topics related to data, all through the eye of scientific ...


5

List of NLP competitions on Kaggle by popularity [number of teams]: Two Sigma Connect: Rental Listing Inquiries [2709 teams] https://www.kaggle.com/c/two-sigma-connect-rental-listing-inquiries Home Depot Product Search Relevance [2125 teams] https://www.kaggle.com/c/home-depot-product-search-relevance Quora Question Pairs [2123 teams] https://www....


5

There's this website called Sportsdatamart which allows you to download CSV and XLS file formats for a number of Football series like the England Premier League, the Italian Serie A, the German Bundesliga and the Spanish La Liga. On Football Data UK, you can find EXCEL and CSV data files to use for quantitative testing of betting systems in spreadsheet ...


5

Non-Negative Matrix Factorization (NMF) is described well in the paper by Lee and Seung, 1999. Simply Put NMF takes as an input a term-document matrix and generates a set of topics that represent weighted sets of co-occurring terms. The discovered topics form a basis that provides an efficient representation of the original documents. About NMF NMF is ...


5

Firstly, for understanding the Markov switching models, a nice knowledge of Markov models and the way they work. Most importantly, an idea of time series models and how they work, is very important. I found this tutorial good enough for getting up to speed with the concept. This is another tutorial on a similar application of the switching model, which is ...


5

First of all, data only comes in so many forms that it might make sense to stick to a more "concrete definition". Data Science is necessarily practical. But here are a few other books with a more theoretical grounding. Others will certainly know many more... A probabilistic theory of pattern recognition by Devroye, Györfi, Lugosi An Introduction to ...


5

Though neither are well defined, as commonly used they are somewhat orthogonal concepts. In my opinion, AI has a fairly narrow definition - it is about optimization through actions. AI is about decision making, either in deterministic or probabilistic environments. Typically, this is operationalized as action selection to maximize some reward function, or ...


4

Some which I regularly hear to, are: What's the point by FiveThirtyEight It is a very nice podcast, where not only the concepts, but also the applications of data science to a wide range of domains, are discussed. Linear digressions by Udacity It focuses more on ML and concepts of data science. Hosted by two really nice data scientists Katie and Ben. ...


4

The NLTK book is by far the best tutorial on basic NLP I have seen(in Python). The Coursera course on NLP is also fairly good. It takes off from the basics and takes the student to a novice level.


4

Java I'd have to disagree with the other posters on the java question. There are certain noSQL databases (like hadoop) that one needs to write mapreduce jobs in java. Now you can use HIVE to achieve much the same result. Python The python / R debate continues. Both are extensible languages, so potentially both could have the same ability to process. I ...


4

Yes, multiple papers have used this. I've heard of multiple ways to exploit this hierarchial structure. This paper Hierarchical Deep Convolutional Neural Network for Large Scale Visual Recognition uses multiple levels by predicting the more coarse distribution and I think it then passes this as features to the more low level classification. YOLO9000 actually ...


4

I am using keras with tensorflow backend. I checked and the categorical_crossentropy loss in keras is defined as you have defined. This is the part of code (not the whole function definition)- def categorical_crossentropy(target, output, from_logits=False, axis=-1): if not from_logits: # scale preds so that the class probas of each sample sum to ...


4

I think the closest problem that has been addressed with deep learning is image inpainting, that is, filling a blacked out region in the image: For instance, this paper: Semantic Image Inpainting with Perceptual and Contextual Losses. So it is certainly possible to fill missing information from an image with deep learning.


3

Check out the Github repositories for Christopher Long (octonion): Football: https://github.com/octonion/football-public https://github.com/octonion/football Soccer: https://github.com/octonion/soccer-m https://github.com/octonion/soccer Many others: https://github.com/octonion?tab=repositories


3

The Stanford NLP course on Coursera covers Sentiment Analysis in week 3: - What is Sentiment Analysis? - Sentiment Analysis: A baseline algorithm - Sentiment Lexicons - Learning Sentiment Lexicons - Other Sentiment Tasks For coding tutorials see: Stream Hacker's NLP tutorials Basic Sentiment Analysis with Python Andy Bromberg's Sentiment Analysis ...


3

Since you like Keras, the main author has written a book on deep learning with Python. You can check out the sections to see if it covers all the topics you want.


Only top voted, non community-wiki answers of a minimum length are eligible