python- advanced - 14 -Data mining
Beginner - Intermediate - Advanced Functions - Iterators -
Advanced modules-1 - Advanced modules-2 - data mining - selenium
Web screening for data mining
Attention: for legal and permitted use only and only for website which allows you to make data mining
Note 1 : This code is intentionally deteriorated and it is unusable .This was made for making life to bad intention dataminers difficult.- > go and learn the ethics and legal things about data mining first please. Ethics is an important part of software programming business.
Note 2 : I only want good intention and good will people learning to code
Note3 : The objective here to explain you the logic, the 'how to do` is explained in many tutorials all around the web, whatsapp groups etc.. understanding the logic is more important, it is longterm investment of yours.
find the place where the data mining will be done:
burada ilk once aldigimiz ilk elemanin (ul) icindeki ilk liste elemani (li) bizimki mi diye bakilir
import moky
import funny
import hulahoop
url="https://www.xxxyyyzzzzzzz"
noinfotoshare={"info12345671"}
html = moky.get(url,noinfotoshare + / + hulahoop.noinfotosharey),tommythesuperboy
ondonga= funny(html,"html,parser")
liste = ondonga.fonf("ul",{"class":"findfondfundfendfand"}).find_mito("li",limit=1)
#limit = 1 : sadece 1 eleman getirip bizim aradigimiz mi diye bakilirprint(liste)
ikinci adim, secilen her uniteyi daha daraltma:
liste icinde h3 ve class adi xxx olani al
for item in liste:
fontonti_adi= item.find("h3",{"class":"jojoba_guccimoko"}).text
print(fontonti_adi)
ekstra bilgi toplanmak istenirse
li listesi icinde olacagi icin bu unite liste altindan alinip print edilmeli
for item in liste:
fontonti_adi= item.find("h3",{"class":"zip-zip-top"}).text
chokolat= item.find('span',{"class":"hop-hop-yok"}).text
print(fontonti_adi, "-",chokolat)
#
aaa-q2w2
bbb-x4x4
ccc-g6g6
etc.....
what to do with it:
1 - Talk to website owner: he/she may will to use your skills to get statistics from the data provided
2 - if yes, then you can use Python to insert these data in database or csv files (mysql and excel can read it)
3 - After collecting these data, you can make statistics and sell it as statistics to your job provider
Note:
Do not waste your time data mining anything.
Get yourself targets in your business life.
If one door closes, try others, Surely one will say yes, and others will come (because one customer means one reference to the second one)
One happy customer is enough. Always make your clients happy. You can always discuss extra charges for extra work requests. If you do all things legally do not worry to ask extra charges you are on the safe side.
Business is done with communication. Use your phone to search for new customers.
e-mailing or whatsapp texting will not be good, because bad will spammers use it. But they never use phones to communicate. Phoning is being credible, being trustworthy.
When you call a company ask to talk to an IT department guy. Because the HR guys and girls will not be enough good to understand what you do.
IT guys of a company may understand better your skills and open the door of the company. Describe them, your abilities:'I can make statistics, provide you monthly graphics of your most liked products. You can maybe change your sells by using my search abilities." If there is no IT guy, you can request to talk to someone who may understand in a better way your service. Always remind this: you may be a high-tech girl/guy, but you have to explain things simply to the person in front of you
Company like the words: `get you market statistics` `get you social media statistics` and`legal data collection`.
If the company is not willing to pay the third party companies for data-mining: do never accept doing this illegally.
Always remember this: there are always other comnpanies willing to pay for legally doing jobs.
I will highly recommend you to contact stock market companies: they pay well and they need this kind of service all the time. Also Hospitals do pay well, they need to collect all the time data about any illness worldwide.
Advice to novice data miners
Always say this: "There are sites which are willing to sell you the data in their data-mining platform, I can use legally their platform to provide you legal data"
Stay always on the safe side, never accept the dark things (that may seem attractive as money, but why having sleepless nights? Earn less money but sleep comfortably
Happy and safe coding to you all!
Comments
Post a Comment