1) Module doesnt fetch thumbnails at all anylonger at my website
2) If thumbnail is not ready at shrink the web, no picture is downloaded. Previously we had a workaround by refreshing the screen several times and waited untill Shrink The Web fetched the thumbnail.
i would be satisfied if this problem will be put in the ticketing system.
meanwhile i will try to figure it out myself (although i dont have the luxery of time to figure this thing out), or if one of the programmers inhere can be as kind to have a look ...
As I understand it, shrinktoweb made some changes to their registration system and the code in Dolphin doesn't work. They said Boonex finally got ahold of them and they would try to fix it when they got the chance. That could be forever if we have to wait till 7.1. I hope a patch or something can be released. I just found an need for this module and would like to get it to work.
I got this message from one of the founders of ShrinktheWeb when I was trying to figure out if it was a problem with a firewall on my host. He said it took them weeks to even get Boonex to acknowledge them but he has since talked to them. This is why I wish Dolphin was really open source - we really need this fixed. I wish they would release a patch on this, because if we have to wait till 7.1 it will be a lifetime. Maybe someone could do a mod that fixes this - or do one with another thumbnail service like http://www.thumbshots. org.
--------------
Hey Rob,
There is no other IP address for our service. The problem resides with the Site module in boonex. We have changed our request method and until they update the code in that module there is nothing more that we can do. I've spoke with their developers and as soon as they resolve their DDOS attack problem we'll start working with them to correct the issue.
Just to clarify this for myself, does this work for anybody anymore? A business possibility has come up where this module would be very useful. Does anyone out there have any influence with Boonex where we could persuade them to fix this? Short of that, maybe one of the mod developers could fix it? The API for shrinktoweb can't be that complicated.
A quick solution would be to open such service and simple offer the same as they did with same parameters and such to easy the move to a new service.
Problem is to find a solution where you can run it on a linux server and run some kind of browser of the framebuffer... I'll see how far my weekend goes ;p
Well, i took some time to dig into this and found out that I could do screen shots from my linux server, now i just need to wrap this to a final solution.
The pictures as result is here as example of output, they need to be cropped/resized ofcus:
I think www.thumbshots.org is a nice service also, but this is not really the fault of shrinktoweb either. Boonex has to do something - does anyone know the developer responsible for this? Alternatively are there any code wizards out there who could take a shot are release a new module? I hate it that every time I get excited about some Dolphin module I find it doesn't really work.
I hope you did read the forums on shrinktheweb well. The new way the users have to click 3 times before they reach the destination.
A smarter way would be to use to use a local cached version that have a ttl of say 3-7 days and when you request a new updated version if there is any.
That way you are less dependet on external services for your site to run proper, just do a google search on websites that is fully dependent on this service and how they look now.
Yes, you can run my 'solution' to take screenshot on a VPS or dedicated server. It is using xvfb with a screen capture program, but you have to resize them and crop the images to be 200x150.
I have made a replacement script that works like shrinktheweb and only thing you have to do is to change the URL in your settings, i hope i'll finalize my script later this day to temporary fix the problem until Dolphin 7.1/7.0.7(?)
Again, my way would been to add a field to the database of a ttl when the image should be requested again, then fetch the image, store it local, set the ttl of the users choise, have a cron script that is running */5 to check if any pics should be downloaded/updated from users ttl.
After reading Sky's forum post and found the IPs they was talking about i finaly got it to work.
The problem i was into was the talk they said on their own forum that some parameters was gone, and they was going to remove the xino.php and replace it with javascript instead and therefor belived what they was saying there. Instead it seems all that are bs to be honest, it works perfectly!
My main problem was that I already added some sites and belived it was going to fetch the thumbs when the service was up/working again but it don't.
I had to re-add my sites and dolphin _does_ cache the files localy, even if i could not see where the heck they do it...
So bottom line, add your IPs, else tick the Logging box and add some sites and go back to their site to see from what IP your requests are comming from and add that to the list. Remove Logging and you have to re-add the sites for the thumbs to be fetched.
So my concern is still that if a person adds a site, and stw don't have it, you have to remove that site and re-add it to fetch the thumb ?
Anyway, I did learn how to do screenshots from a linux console too.. )
There seem to be a few changes in Trac - I noticed some SQL changes - has anyone tried it yet?
At first I was ready to pull my hair out that the issue had a fix that no one was telling us about despite the number of posts crying out for help. Then I realized after trying to implement the 'fix' that this is just another case of an issue being declared "fixed" and yet still being broken:
I couldn't see any changes at all in the changeset 15055 - the file is unchanged, so I'm not sure what that's all about.
I did see changes in 15051, but when I made the changes in the changeset 15051, the sites module stops working altogether, throwing this error:
Parse error: syntax error, unexpected T_ELSE in ****/public_html/modules/boonex/sites/classes/BxSitesModule.php on line 892
So I removed that change from trunk/modules/boonex/sites/classes/BxSitesModule.php entirely, leaving the other 2 intact. Then my site module is actually working and for the first time in a while, the thumbnail box appears when adding a new site. However, the thumbnail box is grayed out, no matter how many times I reload the page. It's trying to work, but still not working.
(Just f.y.i., in case anyone is actually following up on this: I implemented all of the changes for shrinktheweb when the upgrade was released. I registered my own account there, listed my ip, entered my own access and secret keys. So none of that is the issue.)
Again - anyone know how to disable the shrinktheweb features from the Sites module entirely so that it doesn't appear broken to my users? Anyone?
i just dont inform my visitors that they can do this.
they add their site .. and upload a picture ..
When they start the add a site process, there's a message that pops up that says "if your thumbnail doesn't appear, refresh the page." And since no thumbnail appears, they just keep refreshing and refreshing. To them it is just confusing and makes it look like it's broken (which it is), and I don't want my site to appear confusing and/or broken to my users. (a concept that seems foreign to dolphin)
I suppose I could just undo the so-called fixes that make a blank thumbnail box appears and change the language key to "Upload a pic for your site" - but I'm so sick of sloppy fixes like this that aren't really fixes at all. Surely there's a way to just turn off the shrinktheweb feature entirely!
ArgonX are you saying that you got Module Sites to work, but it will not fetch a thumbnail if STW does not have it ?
How about your linux solution? Can we implement it on our own VPS? will it work? and if so, are you willing to share the code? :-)
I noticed that when you add a site, it does request a thumb from swf, if they dont have it, you simple can't get one, and dolphin never saves it. Re-adding a site after say a couple of hours and the image are ready on stw. Therefor a cronjob should be running to check all stites that have been added without thumb and try download them and save them localy as dolphin does in the first step.
Absolutly, i mind sharing my 'code' / 'solution', I never got to implant it, but i got php scripts that returned same parameters as stw did, but problem remains that dolphin still only fetches the image once when the site are added, and dont re-try to fetch the image at a later stage.
Here you can see what i used for tools to capture the images, http://cutycapt.sourceforge.net/ i used it together with xvfb. You need to write php script that simple adds the url to a db, have a cronscript to generate the images, and the xino.php should return a valid xml document with parameters if the image are ready or not and give out thumb url. I got halfway with this before i noticed to add my ips of my servers and abandonded the idea, but i might use it later as a backup solution.
Again, check the code of dolphin, it only doing the fetch once and it's when they add the site so a fix would be to write a custom cron script to run and fetch missing thumbs instead.
how about instead of having a cron job checking for new thumbnails.
Having a check each for a new thumbnail time someone views the sites?
That means we need to modify the code itself within dolphin, and it will be removed when next update comes, having an external 'fix' dont break dolphin, imho.
how about instead of having a cron job checking for new thumbnails.
Having a check each for a new thumbnail time someone views the sites?
Something tells me the script updating thumbnails every time someone views a site entry would cause unnecessary load on the server.
Well, it would work, but it should only check if there is a image ready to be fetched and then save it localy as it does when you add a site, and use the stored local copy. That way it would work if you make a clean up or have a cron script to remove thumbs that is older than a month so you always have a 'fresh' picture of the site.. many options how to do it, but as it is now, an external script could do it since i don't want to poke around to much within dolphin until i have learnt more from and how the site really works.
I checked cutycapt, and it is really promising. i rather have this service at my own vps then using STW... simply bcs i dont want to be dependant.
But i am having my VPS on CENTOS .. and there is no installation guide to be found. On top of this, i am a real novice with linux/vps/centos etc etc. if you can help me a bit, or know a guide that can help me a bit, that would be great :-)
regarding re-programming the sitemod ..
I think we could call the function that is 'normally' called on creation of thumbnail. Parse the URL and it will quickly check if a thumbnail is available, if not a NULL will be placed in the database. you could program an extra line in the views function, just check if database table contains a NULL .. if so, go check if a thumbnail is available. ofcourse this is theoretically . i dont have the time to shift through the code, no matter i how much i would like it to work.
bx_sites_main->photo will be 0 if no thumbnail is fetched. but will be anything else but 0 if thumbnail is fetched, or user uploaded a picture
anyway, cutycapt will resolve my problem .. correct? :-)
Speaking for myself, I've researched it for hours, implemented every fix (including your supposed sure fire fix of adding IP (did that weeks ago when it was first listed as a fix) and checking the log box). It would be terribly fabulous if it worked, but despite having researched it, despite having implemented every *fix*, despite refreshing 10 times (which wouldn't really be a *fix* anyway for my end users on my site, of course), and despite your attitude:
It still doesn't work!
And considering I'm apparently not the only one who is still experiencing problems, I think it's safe to assume that there is, indeed, still an unresolved issue here. I'm glad it is working for you, but that doesn't mean that it's working for everyone!
Yeah, I third that notion - I think I have researched this issue quite a bit - including talking to the co-founder of shrinktheweb, before this "solution" was posted - I'm sorry people consider working to resolve technical issues here to be "bitching".
Technically, I am still unclear on one thing - are the shrink the web images stored locally - outside of the cache? Maybe a quick fix - for my situation anyway, would be to disable shrinktheweb entirely - at least for now. I noticed that after you get the second screen (which I usually don't get because of my hosts firewall) that give you the option to upload a thumbnail from your hard drive. Maybe this could be temporary fix for some smaller directories - just make the thumbnails manually, and then upload it. Could someone tell me the code location to comment out - I would like to experiment with this.
bump - sorry - but does anyone know where the code for calling shrinktheweb is? I would like to try to comment it out as an experiment. I'm thrashing around in FTP now, but I really don't know PHP well enough - is it in one of the classes files?
Oh comeon, someone must know where the shrinktheweb calls are in this code. Does Boonex ever help anyone on this forum anymore? Argonx - if you wrote me I didn't get the message - I got a bunch of email alerts but no messages, which happens here on my account. Could someone at least tell me what file?
foreach ($defaults as $k=>$v) if (!isset($args[$k])) $args[$k] = $v;
$args["stwUrl"] = $url; $request_url = urldecode(getParam('bx_sites_thumb_url') . '?' . $this->_httpParseQuery($args)); <-- Right here the URL is retrieved from database! $line = $this->_make_http_request($request_url); $regex = '/<[^:]*:Thumbnail\\s*(?:Exists=\"((?:true)|(?:false))\")?[^>]*>([^<]*)<\//';
Damn - I have commented out that entire function and I still can't get through my host's firewall - it is still hanging for me.
@Boonex - it would be really nice if one of you guys would respond here on occasion. Could you advise - are there any other external calls in that program? I would like to disable shrinktheweb entirely right now, and just generate the thumbnail manually. Could you tell me how to do this?
I got this email from shrinktheweb, dated 4/22, so it doesn't look like they're done changing things.
This notice is just a proactive alert that we are going to be making some MAJOR changes to the system. Our timeline for some major initiatives has been sped up drastically over the past couple of months and we will be rolling out several major overhauls simultaneously. Read more about that here: http://www.shrinktheweb.com/blogs/all-ahead-ludicrous-speed.html
hey nice ass you are correct sir... i also read that there should be no affect with using there old api but that is for sure not the case.... it will pull the website info into the dolphin mod (7.0.6) but will not pull in the snapshot....
I still wouldn't mind one that bypassed shrinktheweb entirely, and let us manually generate the thumbs. It wouldn't be nearly as good, but it would be something. I don't know why commenting out that entire function didn't work. I'm going to try to get my host to look at it.
I still wouldn't mind one that bypassed shrinktheweb entirely, and let us manually generate the thumbs. It wouldn't be nearly as good, but it would be something. I don't know why commenting out that entire function didn't work. I'm going to try to get my host to look at it.
Did you try commenting it out like this: ? (Everything but the return null; line)
Yes, I commented out that entire function - but also the null part - I'll try it with the null still in there. Thanks.
Try it exactly as above. Returning 'nothing' is not the same as a function that does nothing. This appeared to behave like you wanted it to when I tested it, but it may of course, behave differently in your server environment.
Make sure you clear all the cache directories after this change is saved.
My opinions expressed on this site, in no way represent those of Boonex or Boonex employees.
First is to install the following line of code into the header* of your page(s): <script type="text/javascript" src="http://www.shrinktheweb.com/scripts/pagepix.js"></script> Then in the body of the page (wherever you want to show a screenshot), you just put: <script type="text/javascript">stw_pagepix('domain.tld', 'stwaccesskey', 'stwsize', 'language', 'stwargs');</script> *The header of your page is between the <head> and </head> tags
Legend:
* domain.tld = the domain you want to show * stwaccesskey = your STW Access Key (found in the HOME/LOBBY area) * stwsize = the output size you want to show (tny, mcr, xsm, sm, lg, xlg) * [OPTIONAL] language = English (EN) is the only language currently supported * [OPTIONAL] stwargs = the pro features in a single string (i.e. &stwfull=1&stwxmax=400) o If &stwxmax is specified, it will override the stwsize value
Go to STW and Lock to Account your IP address and your web URL into the Allowed Referrers Field.
Example:
xxx.xxx.xxx.xxx yoursite.com
End of Lock to Account
In the DolphIn Admin Back End go to Modules Sites And Make sure it looks like the following:
Url: http://images.shrinktheweb.com/xino.php Name of service: Leave Blank Name of action: Leave Blank Access Key: Your STW Access Key Secret Key: Your STW Secret Key
End of Mod Setup
Clear All Cache's
NOTE THIS IS JUST A START THE ADMIN BACK END HAS NOT BEEN DONE YET AND I MAY HAVE MISSED A FEW VIEWS IF ANY THING COMES UP I WILL ADD IT AT A LATER DATE.
OK after setting up for 7.0.7, just make sure you remove the Name Of Service and Name of Action values in the Settings on the Admin page. This immediately creates a greyed thumbnail for the site grab, and upon completion of the submission form, the thumbnail is instantaneous. If you leave those values in, the script does not generate thumbs.
Even Monkeys and Retards get it right with repitition! - Author Unknown
There is one view you missed and that is the "Rater" view, but following along in the same vein as the adjustments to the other files you've shown us one can easliy fix the issue in the file...
We have heard from several users who would like to see a better integration with our service and we would like that also! Therefore, we have launched a contest for Dolphin developer's to get that accomplished, drum up some friendly competition, and reward the lucky winners. If you know any "Dolphin" developer gurus, be sure to point them to the announcement "Note":
I have looked at all the code by Rdonovan, and stil do not know where to put the following:
"Then in the body of the page (wherever you want to show a screenshot), you just put: <script type="text/javascript">stw_pagepix('domain.tld', 'stwaccesskey', 'stwsize', 'language', 'stwargs');</script>"
Which files does this affect?
Even Monkeys and Retards get it right with repitition! - Author Unknown
The code snippet you mention is for ShrinkTheWeb's "Preview Verification Page" (PVP), which we have not yet had time to mention but the PVP is no longer going to be necessary or supported. We have gone back to the simple method, which only requires the direct, single line of code as can be copy/pasted from the lobby once logged in.
For more info on why we decided not to enforce PVP, read this announcement.
I made all the changes, and it immediately picks up the thumbnail, but does not have a large photo when you to to the Site detail page. Any suggestions?
Even Monkeys and Retards get it right with repitition! - Author Unknown
I made all the changes, and it immediately picks up the thumbnail, but does not have a large photo when you to to the Site detail page. Any suggestions?
No problem but I must apologize that I cannot be of much assistance with customizing your integration.
The upcoming SITES module will automatically handle all of this for you, without all the headache of customizing in the code. However, I did not write the integration for Dolphin; only tested it. So I cannot speak as to where certain code should go in order to display the way you want it. Really, I would strongly recommend waiting for the next release of SITES module, if you are able to wait.