Scraping Websites
Holy crap. So I was browsing around freelancer.com
and found that someone looking for someone to scrape a site. I spent time writing and scaping the data to make sure it worked and I figured I could put that I was done in the bid. I know, stupid move on my part, there goes two hours down the drain.
Then I signed up to bid and it turns out you can only bid on projects that are put out after you sign up. That is totally retarded. To make it worse it is inconsistent as some previously posted projects in my qualified fields would let me bid. Even the live help tech couldn't seem to figure it out.
I assume most people sign up because they see a project they are interested in. I was so aggravated that i tried the live help. They were not much help after all.
You are now chatting with Michael B. (General)
Paul: hey there
Michael B.: Hi there, how may I help you?
Paul: i signed up for freelancer.com because I saw a project I was interested in
Michael B.: What's the problem?
Paul: but once I signed up, I could not bid because
Paul: it says I was not qualified before the project was put out
Paul: it was really the reason I joined
Paul: is there any way around that
Michael B.: You must edit your qualifications.
Michael B.: Go to My Profile, click My Qualifications.
Paul: I did that
Paul: it is set
Paul: but it says I cannot bid on the project because my qualifications had to be set before the project was offered
Paul: which means in reality I cannot apply for anything currently on the site
Paul: this is the one I want to bid on
Michael B.: Yes, if you edited it now, you can only bid on the new projects with those qualifications.
Paul: and I have data mining and web scraping set in my quaifications
Paul: you guys should put that someone in the signup info
Paul: because I would never have joined
Paul: I spent like two hours figuring out the project
Paul: and then wanted to bid so I signed up
Paul: I would not have bothered had it said, "You cannot apply for any project currenly on the site"
Michael B.: I'm sorry, but it is automated by the system. I'm pretty sure, you can find other projects similar to this one.
Paul: there is no way around that?
Paul: ya I just already wrote the script ;(
Michael B.: No, even I cannot access it.
Michael B.: I'm sorry, paul.
Paul: okay thanks anyways, you really should have a disclaimer about that
Paul: its kind of misleading
Paul: when its implying sign up now to bid on the project
Michael B.: Would you like to search other projects instead?
Michael B.: There are a lot of Data Mining and Web Scraping projects in our website
Paul: ya but following your logic
Paul: I cannot actually bid on any of them
Paul: so whats the point
Paul: I have to wait for new ones to arrive
Michael B.: No, you can bid on new projects.
Paul: new meaning, tommorow
Paul: and they are not there yet?
Michael B.: Wait, let me see the list if there are other projects, ok? :)
Paul: ok
Michael B.: hold on
Paul: e.g. I tried to bid on the latest project in the web scraping list
Paul: and it still tells me no
Michael B.: Really? Ok, can i have your username?
Paul: paulsidekick
Michael B.: Ok, hold on, let me check
Paul: I have web scaping selected in my qualifications
Paul: but as I just signed up there is no project I can bid on as they all were started before I was "Qualified"
Michael B.: How about this one:
Michael B.:
Michael B.: You can bid on this
Paul: How is it possible that I can bid on that
Paul: when it was started 7/24
Paul: and I was not "Qualified" untiil 7/27
Michael B.: Hmmm, but there is a bid on this button.
Michael B.: Can't you see it?
Paul: ya seems inconsistent
Paul: what differs about
Michael B.: That rule will only apply if you change your qualifications NOW. But since you are a new member, you can actually bid.
Paul: then why can't I bid on that one
Michael B.: There must be some restrictions on the last project that's why you can't bid.
Paul: it says
Paul: You are not qualified to bid
on this project
Paul: but I have web scraping selected
Michael B.: hold on
Paul: and it is registered under that
Paul: it says job type: * Data Mining * Web Scraping
Paul: and I have both of those qualifications selected
Paul: the reason i care about that one is that i already did the work
Michael B.: hold on, this is weird
Paul: k
Paul: thanks for looking into it
Michael B.: hold on, this is weird
Paul Visco: k
Paul Visco: thanks for looking into it
Michael B.: Hi Paul, I'll report this to the bug department, ok?
Michael B.: However, please don't do any project if you still haven't bid for the project.
Michael B.: And there is no way also of knowing if you're going to win the bid.
Paul: right I realize that
Paul: i was just excited to test it out
Paul: how will i find out if it changes
Paul: should I just keep checking back
Paul: or will someone email me
Michael B.: I understand. Just move on with other projects. :) There's lots of them.
Michael B.: Nope, I'm afraid not.
: I understand. Just move on with other projects. :) There's lots of them.
Michael B.: Go here to browse the Data mining projects
Michael B.:
Michael B.: and the web scaping ones
Michael B.:
Paul: they almost all say: ou are not qualified to bid
on this project. Click here to edit
your qualifications.
Paul: but I have selected those
Paul: web scraping and data mining
Paul: I mean the one I wanted to bid on is number two newest project in that list
Paul: and neither that nor number one let me bid
Michael B.: Try other projects Paul.
Anyways, if anyone is looking for a scaped catalog of forcalprice.com in csv format with SKU, description, title, image urls, product url and price - I have it lol.
and found that someone looking for someone to scrape a site. I spent time writing and scaping the data to make sure it worked and I figured I could put that I was done in the bid. I know, stupid move on my part, there goes two hours down the drain.Then I signed up to bid and it turns out you can only bid on projects that are put out after you sign up. That is totally retarded. To make it worse it is inconsistent as some previously posted projects in my qualified fields would let me bid. Even the live help tech couldn't seem to figure it out.
I assume most people sign up because they see a project they are interested in. I was so aggravated that i tried the live help. They were not much help after all.
You are now chatting with Michael B. (General)
Paul: hey there
Michael B.: Hi there, how may I help you?
Paul: i signed up for freelancer.com because I saw a project I was interested in
Michael B.: What's the problem?
Paul: but once I signed up, I could not bid because
Paul: it says I was not qualified before the project was put out
Paul: it was really the reason I joined
Paul: is there any way around that
Michael B.: You must edit your qualifications.
Michael B.: Go to My Profile, click My Qualifications.
Paul: I did that
Paul: it is set
Paul: but it says I cannot bid on the project because my qualifications had to be set before the project was offered
Paul: which means in reality I cannot apply for anything currently on the site
Paul: this is the one I want to bid on

Michael B.: Yes, if you edited it now, you can only bid on the new projects with those qualifications.
Paul: and I have data mining and web scraping set in my quaifications
Paul: you guys should put that someone in the signup info
Paul: because I would never have joined
Paul: I spent like two hours figuring out the project
Paul: and then wanted to bid so I signed up
Paul: I would not have bothered had it said, "You cannot apply for any project currenly on the site"
Michael B.: I'm sorry, but it is automated by the system. I'm pretty sure, you can find other projects similar to this one.
Paul: there is no way around that?
Paul: ya I just already wrote the script ;(
Michael B.: No, even I cannot access it.
Michael B.: I'm sorry, paul.
Paul: okay thanks anyways, you really should have a disclaimer about that
Paul: its kind of misleading
Paul: when its implying sign up now to bid on the project
Michael B.: Would you like to search other projects instead?
Michael B.: There are a lot of Data Mining and Web Scraping projects in our website
Paul: ya but following your logic
Paul: I cannot actually bid on any of them
Paul: so whats the point
Paul: I have to wait for new ones to arrive
Michael B.: No, you can bid on new projects.
Paul: new meaning, tommorow
Paul: and they are not there yet?
Michael B.: Wait, let me see the list if there are other projects, ok? :)
Paul: ok
Michael B.: hold on
Paul: e.g. I tried to bid on the latest project in the web scraping list

Paul: and it still tells me no
Michael B.: Really? Ok, can i have your username?
Paul: paulsidekick
Michael B.: Ok, hold on, let me check
Paul: I have web scaping selected in my qualifications
Paul: but as I just signed up there is no project I can bid on as they all were started before I was "Qualified"
Michael B.: How about this one:
Michael B.:

Michael B.: You can bid on this
Paul: How is it possible that I can bid on that
Paul: when it was started 7/24
Paul: and I was not "Qualified" untiil 7/27
Michael B.: Hmmm, but there is a bid on this button.
Michael B.: Can't you see it?
Paul: ya seems inconsistent
Paul: what differs about

Michael B.: That rule will only apply if you change your qualifications NOW. But since you are a new member, you can actually bid.
Paul: then why can't I bid on that one
Michael B.: There must be some restrictions on the last project that's why you can't bid.
Paul: it says
Paul: You are not qualified to bid
on this project
Paul: but I have web scraping selected
Michael B.: hold on
Paul: and it is registered under that
Paul: it says job type: * Data Mining * Web Scraping
Paul: and I have both of those qualifications selected
Paul: the reason i care about that one is that i already did the work
Michael B.: hold on, this is weird
Paul: k
Paul: thanks for looking into it
Michael B.: hold on, this is weird
Paul Visco: k
Paul Visco: thanks for looking into it
Michael B.: Hi Paul, I'll report this to the bug department, ok?
Michael B.: However, please don't do any project if you still haven't bid for the project.
Michael B.: And there is no way also of knowing if you're going to win the bid.
Paul: right I realize that
Paul: i was just excited to test it out
Paul: how will i find out if it changes
Paul: should I just keep checking back
Paul: or will someone email me
Michael B.: I understand. Just move on with other projects. :) There's lots of them.
Michael B.: Nope, I'm afraid not.
: I understand. Just move on with other projects. :) There's lots of them.
Michael B.: Go here to browse the Data mining projects
Michael B.:

Michael B.: and the web scaping ones
Michael B.:

Paul: they almost all say: ou are not qualified to bid
on this project. Click here to edit
your qualifications.
Paul: but I have selected those
Paul: web scraping and data mining
Paul: I mean the one I wanted to bid on is number two newest project in that list
Paul: and neither that nor number one let me bid
Michael B.: Try other projects Paul.
Anyways, if anyone is looking for a scaped catalog of forcalprice.com in csv format with SKU, description, title, image urls, product url and price - I have it lol.
Glad someone appreciates my work
The new online directory is a work of art. The person or persons responsible for designing such an intuitive and useful website deserves our appreciation. The feature I liked the best was the pictures of the people I search for, since I am very bad at connecting names with people. Thanks for the good work.
does this seem like too much
... disclaimer text for editing a phone number to anyone else?


Pink Hearts not Pink Slips
I took this picture for my union's website but I don't think it made it in.


What every developer likes to hear
OMG, I just tried it, it's awesome
I have the best job in america
Working till midnight
No matter how far into the day I push my schedule I never come home on time. Today I got home now at 12:25am. Same on monday but then yesterday I left early for James' (Robert's not Jim's James') birthday so I guess it makes up and tomorrow I plan on attending Thursday in the square.
It all comes down to the fact that I really don't get a chance to program until after 5PM and then I get into a groove and don't want to stop. The time between 5-12am is when I get like 90% of the programming done and can really concentrate. Most of the rest of the day from 10:30-5:00 is documentation, meetings, politics and helping people.
It all comes down to the fact that I really don't get a chance to program until after 5PM and then I get into a groove and don't want to stop. The time between 5-12am is when I get like 90% of the programming done and can really concentrate. Most of the rest of the day from 10:30-5:00 is documentation, meetings, politics and helping people.
Roswell Recycling And Work
Seems like all the suggestions finally paid off as they are looking to implement Bottle and Can recycling at Roswell. I am posting this in case @libertad or @tinypliny are interested and didn't read the in betweeners. I only noticed it because I was reading it while waiting for something to upload.
[box]Recycle Committee Members Wanted
In response to a number of comments that have been received in the Suggestion Box, a small committee will be formed to address recycling of bottles and cans. If you are interested in participating, please contact Cynthia Schwartz via email at cynthia.schwartz@roswellpark.org. The committee will be made up of employees working in each of the 12 major buildings so that the logistics of recycling in specific buildings are taken into consideration as well as the process of collecting, storing, and returning bottles and cans. You will be notified mid-May regarding committee selection and the first meeting date.[/box]
I really wish I could be involved but I seriously don't have time for anything else.
I spent the day doing work for work althought it is my day off. I would say, I could just take the time off next week but I don't have time for that, argh.
[box]Recycle Committee Members Wanted
In response to a number of comments that have been received in the Suggestion Box, a small committee will be formed to address recycling of bottles and cans. If you are interested in participating, please contact Cynthia Schwartz via email at cynthia.schwartz@roswellpark.org. The committee will be made up of employees working in each of the 12 major buildings so that the logistics of recycling in specific buildings are taken into consideration as well as the process of collecting, storing, and returning bottles and cans. You will be notified mid-May regarding committee selection and the first meeting date.[/box]
I really wish I could be involved but I seriously don't have time for anything else.
I spent the day doing work for work althought it is my day off. I would say, I could just take the time off next week but I don't have time for that, argh.
freakin snowing; I just finsihed work
I just finished working for today at 1:00am. I think everything works as planned for tomorrow. I worked at home today because my apple crapbook pro is broken. Getting everything up and running in fedora only took about a half hour. I love linux.
The rest of the day was spent on new development and documentation.

The rest of the day was spent on new development and documentation.

