We designed just for fun an AI algorithm to assist in short-term trading of crypto currencies.
This is the first --very rough-- iteration running in realtime on BTCUSD pair (no delays - besides video upload of course). Don't know how much time it will be up, probably 12 to 16 hours or so.
While technically not 'operable', these are the live results, so you could (in-theory) trade assisted by it while I am streaming. --- hope I am not going against the rules of ShowHN ---
Disclaimer: Trade at your own risk, these data and/or predictions does not imply any kind of advise.
Computer Vision is a highly specialized field. If what you need is an MVP just get some code out of the internet with a run of the mill dataset and create an MVP based on that. That means you don't care about the accuracy, recall, F1, and all the mambo jumbo we do care about and you should if you plan to have a product built around computer vision stuff.
You can even run that kind of stuff using Microsoft and IBMs API out of the cloud for an MVP. If what you need is to test the product idea. Mind you if I were you, I wouldn't even build the product in the first place and do a proper UX work first that will allow you to figure out pretty fast and very cost effective if it makes business sense to pursue computer vision at all.
Now assuming that you have all those angles covered. No, you shouldn't hire a freelancer. This is a piece of technology that is very specialized, very complex and difficult to get right (to fit for purpose) and debug; you either want a contractor company that knows what they are doing and ensure they are skilled in knowledge transfer (the good ones are not cheap). At least if down the road you want your company to be able to build your own team on top of the base technology. Another alternative is to buy a third-party product and deal with the risk of the technology not being fit now or later in a year for your purposes.
Using existing software through an API won’t work because I need the model to work offline.
The idea of hiring a firm is a good one - how would you answer that same series of questions when approaching a firm rather than a freelancer (cost, time frame, needed training images, technical specifications, etc)?
Training images: there is a tension here. You need to know if what you are asking is specialized knowledge (say machine parts) or you can get away with currently available ones. So unless what you need is very general, the answer to that is yes.
Cost: Firms that know what they are doing ain't cheap. It is a simple cost structure issue. Think about it, a single AI guy may cost around 300K year just in salary, so that is a starting point from the cost point of view. They have to make at least enough to cover those costs a year. Now a interesting tidbit that is not known much, not all AI guys live and breath in the United States (aka SV, NY and Boston). Our company is based in Argentina, and we built among other things face recognition software and done research for big names in the states. So if costs are prohibitively, think about shopping off-the-coast, you will be surprised.
Given that you don't have any real target, anyone skilled enough will interview you and figure out pretty fast if you understand what you need. If they push you to give them targets for say accuracy and you cannot back up why you need X or Y, they will know you are not well versed and because of the risk:
1) They pad their cost to deal with your uncertainty.
2) The most professionals will plain refuse to do the project on those terms (I know for a fact because we had rejected many because the clients were not ready to pursue such an endeavour).
Now the most important, there is a lot of smoke out there. Today doing ML work is cool and fancy (so everybody is doing it, right?). Truth is there are not many that know what they are doing, chances are you will end up in a bad spot if you are not very diligent. That is why I suggested first to do the pre-screening UX work first before committing to anything. You will be embarking on the path, only if it really makes sense and you will have spent say 30K to figure out that probably you don't need it, or you need to build something so constrained that you can get away with very rough and trivial tech.
If you go to a firm and ask for a classifier they will probably build you a convolutional neural network or RNN or whatever, sometimes you don't even need that. We had a client a year ago that needed something very specific, they asked us a quite intelligent OCR essentially. We could build it, or retrofit a commercial one, but working with them on the pre-screening we figured out that the use case was actually pretty restricted and because of specific constraints we were able to build in 5 days a solution that is in production to this date (plain old template matching did the trick). They spent 20K up-front, they end up saving 300K+ or even more in the very short run (and have a product out there in 3 weeks instead of 6 months).
How would we do it? In those cases we start with a very small project to figure out what kind of technology we actually need, that may involve UX work or plain ML MVP creation work. Aiming to keep the costs as low as possible with the idea to have something that we can actually test and figure out if that is good enough to be part of the product. Sometimes that involves just incorporate some pre-trained model that you could retrofit, other times it involves scanning for the state of the art and figure out what you need to build in order to achieve the goals. But, in order for that to work, there must be a constraint in time and the understanding that you are diverging toward a solution. It is essentially risk management at its best. I wouldn't trust anyone that doesn't start like that for a brand new Vision based product/feature.
This is incredibly helpful. Thank you. I definitely understand the need to have a clear understanding of the software performance, and I have many of those details already nailed down. I absolutely plan on running an MVP project first to see if trivial tech will suffice, and to get a feel for the firm/freelancer that I'm working with. It could be that my project is constrained enough we do not need the same level of sophistication as many models.
I also am entirely willing to push my project offshore, so long as I can communicate with my partner and am confident that they can deliver.
If I wanted to engage your firm, how could I get a hold of them/you for further discussion about my project details?
I do agree too. Mainly because there is no real visibility of what is going on in between. The usual project management and tracking tools are an affidavit of the real process. Stand-up meetings are no different. There is hardly any real data of what happens in between the affidavits, with no measurement how do you know how you can do your job better as a team?
Between Google, Facebook, Microsoft, Baidu and Yahoo the Machine Learning field is becoming privatized. I just hope they continue publishing their findings.
Our data at Codealike (https://codealike.com) supports the conclusions. When we cross-reference other sources of data like ALM data in our field studies we find that the ratio between actual coding vs. perceptual time (the time we think it took to solve an issue) there is at least a 1.5x multiplier, no matter the team size or the team skills.
Beware though, the multiplier will change based on team size and skill, but will always be higher :)
We built this to optimize numerical algorithms. I am pretty sure there may be other uses. Let me know if you find it useful outside of number crunching.
This is the first --very rough-- iteration running in realtime on BTCUSD pair (no delays - besides video upload of course). Don't know how much time it will be up, probably 12 to 16 hours or so.
While technically not 'operable', these are the live results, so you could (in-theory) trade assisted by it while I am streaming. --- hope I am not going against the rules of ShowHN ---
Disclaimer: Trade at your own risk, these data and/or predictions does not imply any kind of advise.
Feedback is welcome.