Of all the apps I have installed on my phone, the one I most frequently use is Zite. Following todays news that will be changing and the app will soon be uninstalled. It’s a shame, but doesn’t really come as a big surprise as Zite offered a useful, free service – something that is becoming rarer and rarer.
It was my wife who first introduced me to Zite on her iPad. It was an app that filled a void in the market for me and soon became one of the few apps I would look at every day. It’s ability to find stories of interest to me and display them in an easy to browse format was incredibly refreshing. When their android app went through a period of not working well I tried Flipboard.
As with most people my initial reaction to flipboard was “wow” but that faded within minutes. The odd page flipping that was initially “wow” soon became “ugh” and the limited content was annoying. Despite trying to tailor it to my interests the signal:noise ratio was too low – certainly far, far lower than Zite. I found the interface increasingly became an obstacle to the stories with Flipboard, so it was with some relief that updates to the Zite app made it usable again.
I have no idea what the business model was for Zite, but I suspect that being acquired by Fliboard will be viewed as a success by their investors. With the demise of their app I find my phone increasingly resembling and being used as just that – a phone. While the investors may celebrate, I think there will be a lot of users who will view it as a step backwards.
In fact I find myself wondering why I need a “smart phone” at all. I don’t play games. I don’t download music or movies to it. I do use the camera from time to time. The colour screen is nice, but is a camera and a nice screen ample compensation for battery life that is measured in hours compared with the days I enjoyed with a simpler phone 10 years ago?
Recent activity in the IT world has also shown that apps and services have very little user loyalty. The sudden rush of whatsapp users for alternative services following their acquisition by Facebook may be a recent example, but it’s hardly an isolated instance. Using an app and coming to rely on it for anything seems bound to lead to disappointment. Companies now view you as a commodity to be traded at the first opportunity to sell for massive rewards. How did we get here?
This morning I had a request for a few purchases. As WHSmith had everything I wanted I popped in and started gathering the items. The store was organised in some random manner meaning it took a few minutes to find everything, but after the exercise I headed for the tills.
Anyone who has been in recently will know that WHSmith have invested in self service tills rather than staff for the last few years, so I was directed to one of these machines. Despite regularly using them in Tesco (preferable to a 15 minute wait for a manned till) the first glitch took only 3 items to appear. The dreaded “unexpected item in bagging area” message required a visit from one of the “floating” staff, but as she was busy with another machine I stood and waited for around a minute.
The next item refused to scan. I wanted to buy 5 of these, but as they wouldn’t scan and not wanting to wait for a member of staff I elected to leave them.
It strikes me as amazing just how poor my experience was this morning. Not only did I leave feeling that I had received poor service but I had spent far less than I was intending, primarily due to the self service experience. I can sympathise with the desire to cut costs, but where is the line between saving money and customer service drawn?
Another update window popped up in Ubuntu 13.10 a couple of days ago. Lots of packages to be updated (281 if memory serves) so as I wasn’t doing anything that required my laptop, I started the upgrade. After a while it finished and asked to restart. Nothing unusual so far. The restart went OK and the login screen popped up – but where was the mouse pointer? Hmm, that’s odd.
Another restart showed the mouse pointer was present right up to the login screen – when it vanished.
Logging in showed that the mouse was there, but the pointer wasn’t. Moving the mouse around and clicking showed it worked, but there was no pointer. A search of the web threw up a few options, but none have worked. Annoying!
This is the third or fourth time in the last 6 months that an Ubuntu upgrade has created some issue with this laptop. Every time (until now) the fix has been easy enough but has meant spending time hunting around on the web that could have been spent doing productive things. A few years ago this wasn’t an issue I had. The occasional distribution upgrade caused trouble, but generally things just worked. Upgrades and updates were seamless and could be approached without fear. Sadly this appears to no longer be the case which bring to the fore again a question I’ve asked before – is it time for a change?
Of the OS’s I’ve had regular contact with over the last 3 years I find it amazing that the system that has required the least amount of effort is Windows 7! While it has thrown a few issues my way, they’ve all been easy enough to fix. OSX has proved the most frustrating and has caused the most hair pulling incidents, but this may well reflect my lack of experience with it (though things haven’t gotten any easier the more time I have spent). Windows 8 seems like a huge change and may be a step too far, but at least I know it works well on this laptop.
As I’ve been toying with the idea of a new laptop the choice of OS will be a huge factor, so does anyone have any advice or recommendations for me? I need a light laptop as I travel a lot but beyond that I’m open to suggestions…
After much work in the terminal I have managed to get back to a desktop with a pointer.
Last month we decided to move from our older server to a newer, more powerful box. Moving the majority of services didn’t worry me, but knowing how fragile and potentially awkward the mail can be did give me pause. I spent some time and researched the settings and configuration, tested it as best I could and then made the move. All seemed fine for 75% of the users, but a small issue was troubling the rest, so I adjusted the configuration and watched the results.
As usual things were a mix of good and bad, but some spam did get sent. I quickly fixed the problem and moved on. Now 90% of the users were fine but the remaining 10% comprised the most vocal and so suddenly it felt as if 90% of the users were having troubles.
I tweaked a setting here and there over the next few days, but nothing seemed to work. The complaints grew and the language performed the usual subtle changes of tone that desperation seems to trigger. With hindsight the fact that the affected now numbered less than 5% should have signalled me to pause and take more time. Needless to say I adjusted another setting which opened the floodgates! Initially it didn’t seem like an issue as mail was being delivered and spam was being rejected.
Having removed a level of protection too far eventually a spammer found the issue and exploited it. As always this coincided with me being away from keyboard for 8 hours, so the server was subjected to a massive deluge of spam. As soon as I was back I stopped things and removed as many messages as I could before they were sent. Restoring the old configuration I reviewed my changes and found the problem, adjusting the configuration and eventually restarting deliveries. This time I watched and saw that the spam flood had been stopped. Even better the noisy 5% were now happy. Getting into bed at 3am felt good that night.
Of course that was just the start. Having been open for a short period several blacklists noticed and added the IP to their lists. Many hosts refused to talk to the server, so I started contacting the blacklist providers and attempting to restore the reputation of the server. Over the next few days most accepted the explanations and seeing no more spam originating they removed the IP. Things returned to normality – except for Outlook.
I thought that dealing with AOL was going to be the most problematic given their odd and highly aggressive anti-spam configurations, but actually following the steps on their website had the situation resolved in a matter of days. Outlook on the other hand was a whole different ball game.
The first problem is where do you go for help in getting the problem cured for Outlook domains and addresses? The error message in the logs looks like this…
Jan 6 13:43:04 xxx: xxx: to=, relay=xxx, delay=7.5, delays=2.2/0/0.28/5.1, dsn=5.7.1, status=bounced (host xxx.mail.protection.outlook.com[xxx] said: 550 5.7.1 Service unavailable; Client host [xxx] blocked using Blocklist 1; To request removal from this list please forward this message to email@example.com (in reply to RCPT TO command))
That’s fine, but of course I didn’t send the message. The person who did send the message wasn’t interested in forwarding it and simply deleted the returned message having noted that it wasn’t delivered. Not an unusual response from an email user I would suggest. As the person who tried to administer the server surely there is a webpage or some such that can be used to accomplish the same thing? Every other blacklist provider has one!
No explanation or further help is offered. When I reply the message is – yes you guessed it – bounced as the server is blacklisted! Oh, you couldn’t make it up. Trying again with a different email on a different service gives the same denied result and all attempts to find out why are met with a blank wall of copy and pasted text that gives no additional information.
I can sympathise that outlook.com is a huge target for spammers, but making it so hard for others to interact with the service simply means that people will increasingly not interact with it. Large corporations may be able to employ people to spend the time required to deal with the issues, but smaller companies can’t afford such luxuries.
As I typed this I forwarded on a bounced mail to the firstname.lastname@example.org email address and received 2 responses – one saying the message was being processed and another saying the message couldn’t be processed as they didn’t understand it! How can such a large organisation as Microsoft make things so difficult?
Following the arrival of the longer screws, all 4 motors were quickly attached and their directions checked. Only one was incorrect and needed the wires swapping. Despite the colours of the arms clearly showing direction I also went with green propellers at the front and black at the back (as per the first quad) to give additional indications.
After a quick tweak of the PI values and a zeroing of the receiver inputs it was time to see how it flew.
The answer was surprisingly well. Compared to the earlier design there was far less yaw evident when lifting off and the extra indicators of direction made figuring out corrections easier. The shorter legs means it sits closer to the ground which appears to make it slightly less stable just as it lifts, but that was easily corrected. The main issue I ran across was some of the receiver leads came loose and didn’t seem to be seated as well as I’d have liked, constantly becoming disconnected. As I have spare cables it’s an easy fix.
As it was hovering around freezing when I was trying, I didn’t stay out long. The early signs are positive. Now if the gale force winds can just abate to allow me to tune the PI settings…
I recently had a request for a shapefile containing geographic informaton for some of the stations listed on Variable Pitch. I’d been meaning to create a simple export facility for a while, but had never really looked at shapefiles in any detail before. As it took me a few attempts to get them working correctly, the following may help others!
Essentially I’m creating a shapefile with a list of points. Each point will have a series of data fields associated with it. At the present time I’ve not specified types or other details for the fields, but that may be something I do in the future.
Now the writer object is prepared, I loop through the stations I need to add and write the data. This is done in two steps, the first adding the point and the second the data associated with it. As the station names are stored in Unicode and the shapefile expects ascii, I have forced a simple conversion to ascii (ignoring any characters that cannot be converted).
for s in stations:
writer.record(s.name.encode('ascii', 'ignore'), s.category.desc, "%d" % s.id, 'Point')
At this point I have all the data in the writer object, but now need to create the 3 or 4 files that comprise a shapefile. To keep things simple I elected to create a single zipefile containing all the generated files which can then be downloaded. All generation is done in memory.
s = cStringIO.StringIO()
zf = zipfile.ZipFile(s, "w")
# Must close zip for all contents to be written
My initial code simply used the lat/lon co-ordinates I already had stored for the stations, but when the file was downloaded by the person requesting it they complained they had expected the points to be in UK Grid Easting/Northing format. This pointed me to look at the .prj files that are often included in a shapefile and give details of the co-ordinate system used. As the format is simple formatted text (WKT) I found the appropriate text for the formats I support and insert the appropriate text in shapefile.prj and include that with the download.
I’ve been asked about producing shapefiles from the geo data on Variable Pitch. This seems like a good idea, but having no experience with such files I thought maybe I should have an app to test them with. I was pointed at QGis but it needed to be added to the sources list for Ubuntu 13.10. This is how I did it.
I created a file /etc/apt/sources.list.d/qgis.list with the contents
deb http://qgis.org/debian saucy main
deb-src http://qgis.org/debian saucy main
Then I imported the PGP key as the sources are signed.
~$ gpg –keyserver keyserver.ubuntu.com –recv 47765B75
gpg: requesting key 47765B75 from hkp server keyserver.ubuntu.com
gpg: key 47765B75: public key “Quantum GIS Archive Automatic Signing Key (2013) <email@example.com>” imported
gpg: no ultimately trusted keys found
gpg: Total number processed: 1
gpg: imported: 1 (RSA: 1)
~$ gpg –export –armor 47765B75 | sudo apt-key add -
This was all that was needed and so installation was then as simple as
Seemingly hitting the ground on a regular basis with legs that rotate leads to them not staying vertical – who knew?
After spending a lot of time adjusting the rotors on my Talon 2.0 quadcopter frame to try and get them vertical, I decided it was time to look for an alternative frame to use while learning. The constant battle to stop spinning due to non-vertical motors really didn’t help figure everything else out.
When the Q450 frame came back into stock at Hobbyking I decided to get one and try it. Having had it for a while I finally had time today to start assembling it.
The frame arrives with no instructions, but is so simple that none are needed The supplied screws were fine, though I had one that appeared to have skipped a step in manufacture and could not be used. At the end of construction there were a couple of spares, so the rogue screw wasn’t a problem.
The top plate has plenty of holes, but it doesn’t have the 4 holes for the power distribution board I’m using (recycled from version 1 of the Talon quad which came with the holes to attach the board pre-drilled). I stuck the board using the supplied tape and it’s pretty solid, but having the holes available would have been nice.
The other problem I had was attaching the motors. The screws that come with the accessory pack are M3 x 5mm which are too short to allow the motor to be secured to the frame. Longer bolts are required (M3 x 8mm will probably be fine)!
I also bought another KK2.0 flight control board and this has been fitted and flashed to version 1.6 already. Hopefully once I get a the longer bolts and mount the motors it’ll be taking to the skies.
The M3 x 8mm screws arrived and are a perfect match for mounting the motors on the frame. I bought one pack of these, which had one screw with a twisted head, but the rest were fine and 16 are now attaching the motors to the frame.
After upgrading to Ubuntu 13.10 I found that often my keyboard layout, which is selected as English(UK) as it had been since starting to use this laptop, would change to English (US). Annoying as this is, even worse was that it didn’t always happen and would sometimes be fine. The layout is always shown as English (UK) despite the US layout being used, which only adds to the strangeness.
Quite how this odd bug was introduced isn’t clear, but I have found a fix.
Select US keyboard
Select UK keyboard
Hopefully this will be fixed soon, but at least I’ve stopped having so many odd characters appearing in my source files.
I’ve been waiting to update the firmware on my KK2.0 board for a while as I needed a USBasp. The one I ordered turned out to have a 10 pin connector, so I then had to wait for the 10 to 6 pin adapter to arrive! Thankfully both parts are now here and so having time this morning it was time to upgrade from the old 1.2 firmware the board shipped with.
When I first looked at the KK Multicopter Flash Tool I missed the fact it’s a Java application and so, mistakenly believing it required Windows, I hunted down and installed the Windows 7 drivers the USBasp required. This took a few attempts as the drivers I found initially wouldn’t install, though why they wouldn’t install remains a mystery to me. Once everything was installed I connected the board, ran the application and flashed the new firmware in less than 5 minutes.
Once flashed to firmware version 1.6 I powered the board and configured/calibrated ready for a test flight, though with the high wind and heavy rain that wasn’t possible today.
Ofgem produce a lot of reports. They store a lot of data but when reviewing it I’m constantly astonished at how poor the consistency of that data is. Today I have been looking at a PDF they have available which contains a large number of addresses with countries.
This should be such basic data they can’t get them wrong? So why does it list several occurrences of ‘United Kingdon’ and one instance of ‘England’? Is ‘Ireland’ the same as ‘Republic of Ireland’?
If they can get something as basic as the country wrong, what confidence should I have in the rest of the data that I have no way of verifying independently?
It’s probably a silly assumption to make, but surely this report was generated automatically? If so then what does that say about the underlying data structures? This really isn’t good enough for a government department in 2013.
Having built the QuadCopter from scratch I always knew it would need tuning. The initial few flights proved it could fly and that it responded as expected, but I had expected it to be slightly more stable given the reputation of the KK2.0 board.
After those first few flights I started looking for advice on tuning via Google. While these produced lots of opinions and advice much of it was contradictory and mildly confusing. All of it agreed that I needed to adjust the P and I values. Exactly how to adjust them and what the effects of getting it wrong would be was less clear, but as the next step was tuning, I decided I would start changing the values. (However, as I outlined in Changes the timing wasn’t ideal and I probably shouldn’t have.)
The weather finally cooperated, allowing me to fly it for the first time with all the changes in place. The results were mixed. The new cleaner layout was an improvement and the new dome gave it a more robust feeling, but the handling was noticeably worse. Was this due to the new ESC or the changed P values?
Yesterday and today saw more flights and as my experience has grown things have gotten easier, but still I felt that things weren’t quite right and that set me to thinking back to all the advice I had read around tuning the P & I values.
Finding good guides to help with the tuning wasn’t easy and some of the videos weren’t as clear as they thought they were. Watching obviously experienced pilots perform fast manoeuvres over a large area and then declare what needs to be changed isn’t helpful It would be great if someone could write one!
“The KK2.0 board requires flying.”
This was one statement I saw in many different places and led me to think that the amount of effort involved in getting the Quad airborne was normal. That said, when looking at videos of other people flying none seemed to have so much trouble so I suspected something was wrong.
So, what values to start with?
“For small quadcopters start with a P value of 30″
What’s a small quad? Is mine small? It’s certainly not as large as many, but is it small? As I didn’t know I decided to start assuming it was a small quad and so set the roll and pitch P value to 30, I value to 0 but left the limits at their factory defaults.
Higher Values == Better Stability?
30 was certainly too low to start and appears to have been the reason for the challenges I was experiencing.
After changing the P value to 70, the Quad lifted off smoothly and was suddenly far easier to fly! Increasing it to 80 seemed to help even more though a very small amount of oscillation started to creep in. With the I value still at 0 this was acceptable.
Next time I fly I’m going to try increasing the I value and also see if a higher P value gives me a little more stability.
In addition I have ordered a cable to allow me to upgrade the firmware in the KK2.0 board from the 1.2 it comes supplied with to 1.5 (or 1.6) which will hopefully also improve the stability.
After Flying the Quad, I did some more looking around the web and started thinking about tuning the KK2.0 board. This is done by adjusting the PI values, which initially seems like a form of dark art. It wasn’t abundantly clear what these values were until I cam across a piece that identified them as the values used for a PID Controller loop. After reading the page the values I was entering made more sense and some of the advice I had found also became more obvious.
The first step was to change the values and see how it flew. All went well and thanks to the easy menus the values were soon changed. The next few days brought wet and windy weather, so no flying was possible to see if the new values were an improvement or not.
It was at this point that the upgrade parts from HobbyKing finally arrived (have I said before how their shipping isn’t the fastest?). With the benefit of hindsight I should have resisted the temptation to upgrade the frame and flown it to check the new PI values, but I didn’t and so the new ESC was installed and the frame made ready.
In order to use the QBrain ESC, we needed to solder on an XT60 power connector, which was trickier than it looked given the nylon connectors tendency to melt. More than one attempt was required.
The numbering of the QBrain ESC outputs differs from what the KK2.0 board uses, so I had to experiment to get the correct orientation and connections. When ordering I also failed to appreciate how much larger the module was compared with the power distribution and KK boards, meaning the well aligned holes in the top plate were of no use requiring some alternative attachments to be used
It was dark when the changes were finished but undaunted we went outside and powered it up. All seemed good and my calibrating of the ESC was successfully starting all 4 rotors at the same time. Edging the power brought a couple of surprises.
There was a clear pulsing between the propellers
The #2 rotor seemed to be producing noticeably less thrust than the others
After these discoveries I did some headscratching and had a look around the web. The QBrain ESC is still a new product and there wasn’t as much help available as I had found for the Plush models it replaced, but the instructions sheet that came with it showed the default timing was set to Medium, not High. Using the ESC Programming Card I changed the settings and then calibrated the ESC again which seemed to cure the pulsing.
When next flying the quad the #2 rotor seemed to be producing more power, but the addition of the GoPro on top meant the whole frame was unbalanced. I’ll try it again without the GoPro and hopefully that will be better balanced.
With hindsight I made too many changes at once. Given my current lack of experience and knowledge I should have changed one aspect and evaluated the results before changing another. It would have been slower, but that’s not always a bad thing.
Since finishing the construction we’ve had 4 opportunities to fly it. The first of these was largely wasted due to the ESC’s not being calibrated, but the next 3 have all seen the quad take to the air. Today marked the first time I’ve tried flying our older GoPro Hero2 on it.
The GoPro attachment proved to be inadequate and so more thought is needed to figure out a better way to attach it. I have a solution in mind just need to get some pieces and some time to try it.
I anticipated that the learning curve would be steep – and it has been! As with all such things every time it flies things get easier. The initial hesitations about increasing the throttle to get it airborne are reducing and I’m starting to be more gentle with the controls and overcontrol less. That said, after today’s session I have adjusted the PI values to try and improve the handling. Time will tell if these are better or not.
Liftoff occurs with around 45% throttle which I think seems a good point and means there’s plenty of power left. It’s certainly spritely when it starts moving
The frame is proving to be more resiliant to damage than I had feared and despite a few minor and one larger crash it’s still in good shape. Ordering some replacement legs may be on the agenda soon, but it’s certainly not desperate
Ordering from HobbyKing was great for price, but the delivery was expensive and their stock situation highly frustrating. Additionally when ordering the pieces it often wasn’t clear whether pieces I wanted would work together as I envisaged, necessitating much use of Google.
Calibrating the ESC’s
NB You also need to order the accessory pack for each motor as this provides the shaft and attachments for a propeller!
In addition to the above I also needed to do some soldering for various cable connections and the screws are hex (2 and 2.5mm as best I can tell) so suitable tools were required. I didn’t use screw lock for the frame as I was sure I’d be replacing broken parts
The horror stories about charging LiPO batteries aren’t hard to find and certainly deserve being taken seriously, so I wanted to get a charger with some “smarts”. There are so many conflicting views about this that eventually I bought an Accucel-6 50W charger/balancer and a power supply (though the power supply is likely overkill). As an additional safety precaution I also got a charging bag for the battery.
Actually using the charger proved interesting and required me downloading the manual and reading the appropriate section. This would have been easier (and more obvious) had they included a link to the manual in the box, but they didn’t.
The first job we did was to solder all the connectors onto the ESC’s and heat shrink them. This took a while as there are 5 connectors per ESC.
Assembling the frame was easy enough. The motor attachment plates appeared to have the countersunk holes on the wrong side, so we put them on upside down without any problems. I had been hoping to run the wires inside the arms but without fabricating extension leads this wouldn’t have worked, so we just tied them to the side (we decided early on to change our ESC so this was temporary). One thing we didn’t do initially was spend a little time ensuring that all the legs were level prior to tightening the legs, which with hindsight we should have.
Attaching the KK2.0 board was straightforward and connecting the RC receiver was simple enough (though without the online pdf manual getting them in the correct order would have been much harder). Once the ESC’s were attached to the KK2.0 board it was time to power it up
The layout is quadcopter-x and once selected it will show the correct numbering and directions. Again the pdf manual was very helpful for this. Once selected I checked the rotation direction and changed connections as required on the ESC’s to ensure they were all correct.
Calibrating the ESC’s
This turned out not to be as simple as it initially appeared. Reading the instructions for the KK2.0 board provided the basic procedure but as there are a lot of different ESC’s available knowing the beep sequences to wait for was the stumbling block. As I’m using Turnigy Plush ESC’s I eventually found this helpful video that explained where I was going wrong.
Essentially I was waiting too long and so the ESC’s went into programming mode (after playing their funky tune). Being quicker and moving the throttle from max to min after the 2 beeps was all that was required to correctly calibrate them.
After a lot of searching I eventually decided to use 8×4.5 propellers and decided to follow convention and have different colours at the front and rear – green for the front and black for the rear in this case. As you need both left and right rotation propellers for each, this means I should have ordered 4 packs, but managed to misorder initially and only got left handed propellers! When ordering the right handed ones I also forgot I needed both colours and so it took a while to have everything I needed! Hopefully this will act as a warning to others
One thing to note is that the propellers don’t have many markings on them, so it’s not always easy to quickly tell them apart It would be better if they were clearer about what they were.
Having read the various guides online I did a receiver test early on in the setup and zeroed the controller, but by the time we came to fly they had changed so needed doing again. Failing to do this caused an early accident when it flipped on the ground and smashed a propeller
Between my initial ordering of components and the final assembly it has become possible to get 4 ESC’s on a single board, with integrated power distribution. To simplify the design and make things far neater we have ordered one of these boards which will allow the cables for the motors to be run inside the arms and removing the need for extra wiring for power distribution.
As I also plan on flying a GoPro I’m debating how to attach it and balance the frame.
Up, Up and Away…
Following some initial teething problems and after climbing the inevitable learning curve, today marked the first few flights The next post will detail more about that though
Tonight we wanted to watch something via the Sky On Demand service, but when we tried to find the programme there was no option for ‘Catch Up’. Some scratching of heads ensued, then a quick visit to a web page or two. The solution turned out to be simply resetting the network connection and all was well, but obvious it wasn’t. Hopefully this post will help someone else.
In order to allow the debate around renewable energy to be informed it’s necessary to be able to answer these and more questions. Knowing the details of every station will allow many questions to be answered.
“Just the Facts, ma’am”
Variable Pitch has been running for over a year and I have been contacted by people from all sides of the debate. Such a reception has confirmed my view that sites providing information should be totally impartial, regardless of the views of their authors. Opinion and commentary have no place on such sites and I would suggest that a register is certainly in that class.
At a minimum the information needed for each station is (I believe)
Name and address
Dates of key events
Details of renewable generation
Number and type of installed generators
The information collected should then be
be freely available to all
easily searchable and exported
as up to date as possible
as accurate as possible
Following on from work I have done for http://www.variablepitch.co.uk/ some of this information can be obtained from Ofgem. Some of it can be obtained from DECC and some is simply not readily available. Quite why so many companies go to great lengths to not reveal the turbines they install is an ongoing source of mystery and amusement.
Once the information has been gathered the next challenge is keeping it up to date. Most of the sources of information listed above are slow to update (if they ever are). There is nothing that forces developers of renewable energy to inform anyone of their plans until they enter the planning stages. Once complete they only need to supply the information requested by Ofgem. Asking them for information will sometimes result in a reply but often simply results in silence. For an industry that claims to be open there is a lot they don’t want to openly discuss!
Making It Happen
There is no point lobbying the government for such a resource. Even if they were interested and motivated we’d end up with another travesty like the Ofgem website (which is barely fit for any form of purpose).
Any collection of information needs to be totally impartial so none of the trade bodies or protest groups are in a position to manage it.
That leaves us.
I believe that such a site should be created. Further I believe it should be created sooner rather than later. There are people throughout the UK developing websites that collect information on developments in their areas, whether geographic or technologic. Pooling that information would be an excellent start, but we need more. We need to push for developers to be more open and for information to be updated on a more regular basis.
The success of online communities shows what’s possible. Those of us who have experience around this subject need to start talking and thinking about how we work together. If that sounds like you, get in touch!
It’s been a long, long time since I last picked up the Pocket Wizards to do anything but move them from place to place, but after talking the other night about some shots that Rosie would like, it seemed as though I should try and reacquaint myself with the off camera flash toys we have around the house.
As the dogs are always willing subjects (as long as the ball is being thrown from time to time) and I had some time before needing to start cooking, I headed into the garden for a quick refresher.
The processing is a little too dark, but given how long it is since I last played I’m not unhappy with the results. The next step involves heading further into the unknown, so wish me luck!
It’s fair to say that when I started the Variable Pitch website I didn’t know a lot about the energy market or the data that would be useful and available. I had an idea and some data and I started trying to make it available. The site started with just scottish stations but soon I had people asking me about english, welsh and northern irish stations, so I expanded to also cover those countries.
It wasn’t just the coverage that expanded. While I started out focussing on Renewable Obligation certificates (ROC) and their value, I was soon being asked about other aspects of finance related to renewable energy. The Ofgem data provided a way of viewing the output for stations but my early focus on ROC was soon shown to be an error as other financial schemes such as the Feed In Tariff needed to be considered. Then there was the selling of electricity that I hadn’t thought about and the constraint payments made were another area that I had not originally anticipated tracking but something I added to the site.
As with all projects that grow in such an organic manner my initial design of data structures turned out to be totally inadequate. I added the pieces I needed but over time it grew arms and legs on it’s arms and legs. It worked, but adding things was getting harder and harder. Simple maintenance was proving a challenge. Developing the site was also getting harder.
As a result of everything above I finally decided that the time was right to bite the bullet and use the my additional knowledge to develop a better set of structures for the data. This finally allows me to add some of the extra things that I’ve been struggling with – hopefully in a manner that also allows for better maintenance and easier upgrades!
I’ve made a good start on getting things changed and have a lot of the new design work done, so it’s just a question of finding and correcting all the small (and some not so small) bugs before pushing it live. I’m hoping to get that done this week, but it may drift into next week.
“Scottish wind farms paid £1 million to shut down one day” 1
“Record Breaking Day for Wind” 2
The above headlines have both been published recently. They both quote impressive facts and figures – or do they?
Emotions tend to run high when discussing green issues and even more so when discussing renewable energy. It’s an important debate but one that I feel is regularly trivialised by the sort of reporting evidenced by the above headlines. I have some sympathy for the journalists as due to the complexity of the energy market writing about it in an accessible manner isn’t easy, but that’s not an excuse.
In order to have the informed debate that I feel is missing it’s important to establish the facts and it’s at this first obstacle that problems start to appear. People make money from the energy market – lots of money. There are markets where trading takes place and as with stocks, shares or other commodities these markets require real time data. Whenever you mix finance with information you come across barriers, restrictions and payments to the companies that grow to control access to the data.
Without free and unencumbered access to such data it’s impossible to have an honest and open debate of the issues.
Much of the information about the UK energy market is provided by Elexon UK. They have a lot of information available, for free, but when trying to use the information things soon become less friendly. Given what the data relates to and how important it is, the fact that Elexon UK consider they “own” (their words not mine) all information they make available should be of concern.
I previously wrote about my dealings with Elexon UK in April 2013.