Flitterkill Posted October 19, 2016 Share Posted October 19, 2016 Plenty of alternative S3 compatible providers are available now at a price point far better than Amazon. I took a gander this evening to see how far I could go to writing my own file storage method but ran into the expected walls such as having to add the file manually to the System/File directory (Apps and Plugins won't let me hit that stuff natively) so naturally anything I move forward on is going to be messy. I was hoping the included Amazon S3 method was more generic than it actually is but as you know it has more than a few hardcoded Amazon urls and so on. Clearly it's doable and frankly, a generic S3 compatible method is going to be far less trouble than all the hoops you jump through for Amazon S3 specifically. I still might just push forward on this but it is clearly something that is far better suited as an official IPS thing. This would be a big win for IPS users... PS: As an example, Delimiter is offering 100GB storage, 400GB outbound traffic, incoming free, no crappy put/get fees for $33/year on thier drop-in S3 compatible ObjSpace storage system. That's standard pricing which easily beats Amazon (and I'm not even going to mention thier clearly insane Amazon Photo Refugees deal...). Naturally doesn't fly with the hard coded url stuff you got floating around in the storage method. Link to comment Share on other sites More sharing options...
Management Lindy Posted October 19, 2016 Management Share Posted October 19, 2016 Thanks for the heads up. This is something that's been on our radar for a while, but we haven't thoroughly researched alternatives to S3. I'll make an internal note to check this out. Link to comment Share on other sites More sharing options...
TSP Posted October 19, 2016 Share Posted October 19, 2016 We will also be utilizing S3-storage. That S3-storage is delivered by the same host that delivers our servers and is not delivered by Amazon, so I'll have to do the same thing. Link to comment Share on other sites More sharing options...
Flitterkill Posted October 19, 2016 Author Share Posted October 19, 2016 @Lindy you may wish to put this on the front burner - glad to report this is working pretty much out of the box. Spent a few minutes on the tablet looking over the Amazon and parent File method before going to sleep last night and noticed you added in the endpoint stuff recently. After some poking this morning it's working with pretty much no work on my end. All that is needed to add a new file storage option is to add another file in the System/File directory. I just duped Amazon.php and renamed it Delimiter internally. Stuck with just language variables instead of words but that's expected. The thing is, you guys are just parsing out those files into the ACP, reading in the file configuration options as they are set in each file - which in this case is fantastic as you are then saving the file storage configurations as arrays in the already existing database table. That means not having to mess with creating settings or anything like that. Props to whoever made that happen. For Delimiter obj.space S3 storage; that's it. Tested. Bucket writes working. Bucket reads working. Bucket deletes working. I've got an S3 bucket manager/viewer running alongside while testing so I could watch the writes/deletes. All good. And of course, I don't have to dupe the method in System/Files at all - I can just add this in the Amazon storage method and roll with it. All that is really needed on your end is to dupe the Amazon file storage method and rename the lang vars to be neutral, or just turn the Amazon S3 method into neutral wording. Not sure if there is anything else under the hood that needs work but if writes and deletes are good to go I can't see too much trouble... Link to comment Share on other sites More sharing options...
Flitterkill Posted October 19, 2016 Author Share Posted October 19, 2016 Got a few minutes this afternoon to test this some more. Changing storage methods after the fact (switching Gallery images from the Delimiter/Amazon S3 back to file system) worked flawlessly. I'm pretty sure this is production ready for alt-S3 providers. Which is nice because 3 years worth of 2TB S3 storage for $99 is something I would very much like to use.. Link to comment Share on other sites More sharing options...
Joel R Posted October 19, 2016 Share Posted October 19, 2016 Yes. Make it happen. I volunteer @Flitterkill to be the beta tester. Link to comment Share on other sites More sharing options...
Flitterkill Posted October 20, 2016 Author Share Posted October 20, 2016 You can just go ahead and use it if you are feeling it. I'm about to hook up one of my forums with this. If it uploads, reads, deletes, and handles changing storage methods I'm not sure what else there is that can break things... Where it says Amazon S3, just replace that word (in your mind) with Amazon S3 / S3 Compatible Link to comment Share on other sites More sharing options...
tjk Posted October 20, 2016 Share Posted October 20, 2016 Have you tested this running your site in full https mode? S3 and images are broke for me, and have been for awhile, if running your site in https full time. Curious if anyone else is having that problem. Link to comment Share on other sites More sharing options...
Flitterkill Posted October 20, 2016 Author Share Posted October 20, 2016 I have not though the underlying code seems solid. I'll be updating this site to HTTPS across the board and turning this S3 stuff on so I'll let you know. Link to comment Share on other sites More sharing options...
Wonster Posted October 23, 2016 Share Posted October 23, 2016 On 10/19/2016 at 6:06 PM, Flitterkill said: For Delimiter obj.space S3 storage; that's it. How about loading speeds? They have servers only in Atlanta? I'm asking because I'm from Europe and I was wondering if the loading time is good for Europe users Can you test the load time with Stockholm, Sweden server? tools.pingdom.com Link to comment Share on other sites More sharing options...
Flitterkill Posted October 23, 2016 Author Share Posted October 23, 2016 @amator https://ipstest.obj.space/testimage.jpg Knock yourself out. I've found that pingdom tends to indicate slower performance thna what I actually experieince in the browser. I would test with pingdom, and you'll probably see response times of over a 1 second (it is Atlanta, USA to Stockholm after all...), but be sure to just load that link up in your browser and see how it feels. Link to comment Share on other sites More sharing options...
Wonster Posted October 23, 2016 Share Posted October 23, 2016 Pretty good 1.5 seconds for 320 kb pic. Can you add a 2 mb one? I actually experienced the opposite: over 3 sec load for my CiC site, and lower in pingdom Example this is CiC http://addons.invisionzone.com/ Stockholm (pingdom) speed 1.5 sec, browser speed around 3.5 sec Link to comment Share on other sites More sharing options...
Flitterkill Posted October 23, 2016 Author Share Posted October 23, 2016 Sure, hang on... https://ipstest.obj.space/twomegtest.jpg Link to comment Share on other sites More sharing options...
Wonster Posted October 23, 2016 Share Posted October 23, 2016 44 minutes ago, Flitterkill said: Sure, hang on.. 2.8 sec in my browser 2.6 sec pingdom (Stockholm server) 1.8 sec pingdom (San Jose server) I don't know how this compares with amazon s3 Found something. This is amazon s3 stored isn't it? A 4.4 Mb file that loads much faster, around 2 sec in my browser Link to comment Share on other sites More sharing options...
Flitterkill Posted October 23, 2016 Author Share Posted October 23, 2016 https://www.exoscale.ch/pricing/#/storage Those guys are in your backyard and it is apparently S3 compatible; so it might be just as easy to use as Delimiter. 100gig storage is $5/month plus traffic costs. Link to comment Share on other sites More sharing options...
Flitterkill Posted October 23, 2016 Author Share Posted October 23, 2016 That image you posted is coming through Cloudfront, not Amazon S3. Link to comment Share on other sites More sharing options...
Wonster Posted October 23, 2016 Share Posted October 23, 2016 3 hours ago, Flitterkill said: your backyard Yup, saw them. Cheap and Swiss made, what else do u need? Link to comment Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.