What’s new in IBM SPSS Statistics v27?

In June of this year, IBM released the latest version of SPSS Statistics. Version 27 introduces several additional analysis procedures as well as new system enhancements. In this report we take a tour of some of the most valuable improvements that have been made. There’s a video of this tour here as well. Bootstrapping and Data Preparation are now standard functionality One of the biggest changes in this release is that the Bootstrapping and Data Preparation modules are now included with SPSS Statistics base, meaning that they are now part of the standard functionality of the package. Bootstrapping is a […]

Getting started with SPSS Syntax part one

SPSS Syntax has long been exploited by expert analysts due to its flexibility, power and ease of learning. Syntax vastly increases users’ productivity by making it easier to: Fix problems without re-doing everything Carry out repetitive tasks more efficiently Allow analysts to share their work with others Provide a recorded audit trail for better governance Automatically generate results and create scheduled batch jobs In this series of videos we show you how to get to grips with SPSS syntax covering: The basics of SPSS Syntax Easy ways to find help about how syntax works Useful tips and little-known procedures Automating […]

Getting started with SPSS syntax part two

SPSS Syntax has long been exploited by expert analysts due to its flexibility, power and ease of learning. Syntax vastly increases users’ productivity by making it easier to: Fix problems without re-doing everything Carry out repetitive tasks more efficiently Allow analysts to share their work with others Provide a recorded audit trail for better governance Automatically generate results and create scheduled batch jobs In this series of videos we show you how to get to grips with SPSS syntax covering: The basics of SPSS Syntax Easy ways to find help about how syntax works Useful tips and little-known procedures Automating […]

Getting started with SPSS syntax part three

SPSS Syntax has long been exploited by expert analysts due to its flexibility, power and ease of learning. Syntax vastly increases users’ productivity by making it easier to: Fix problems without re-doing everything Carry out repetitive tasks more efficiently Allow analysts to share their work with others Provide a recorded audit trail for better governance Automatically generate results and create scheduled batch jobs In this series of videos we show you how to get to grips with SPSS syntax covering: The basics of SPSS Syntax Easy ways to find help about how syntax works Useful tips and little-known procedures Automating […]

Getting started with SPSS syntax part four

SPSS Syntax has long been exploited by expert analysts due to its flexibility, power and ease of learning. Syntax vastly increases users’ productivity by making it easier to: Fix problems without re-doing everything Carry out repetitive tasks more efficiently Allow analysts to share their work with others Provide a recorded audit trail for better governance Automatically generate results and create scheduled batch jobs In this series of videos we show you how to get to grips with SPSS syntax covering: The basics of SPSS Syntax Easy ways to find help about how syntax works Useful tips and little-known procedures Automating […]

Getting started with SPSS syntax part five

SPSS Syntax has long been exploited by expert analysts due to its flexibility, power and ease of learning. Syntax vastly increases users’ productivity by making it easier to: Fix problems without re-doing everything Carry out repetitive tasks more efficiently Allow analysts to share their work with others Provide a recorded audit trail for better governance Automatically generate results and create scheduled batch jobs In this series of videos we show you how to get to grips with SPSS syntax covering: The basics of SPSS Syntax Easy ways to find help about how syntax works Useful tips and little-known procedures Automating […]

PS Imago Pro – an overview of additional charting capabilities not available in IBM SPSS Statistics

PS Imago Pro is a statistical analysis and reporting solution based on IBM SPSS Statistics. Indeed, apart from the inclusion of an additional menu, users of SPSS Statistics may find that the data analysis module of PS Imago Pro looks almost identical to its SPSS counterpart. However, as Figure 1 shows, this additional menu contains an extensive array of charting capabilities that are not available in SPSS Statistics. In this we can explore examples of these graphing enhancements that aren’t available through the standard SPSS Statistics offering. Combining Tabulation and Charting Each of the charts within PS Imago Pro can […]

Expert insight – Mark Langer Crame, Senior Data Intelligence Team Lead, Jisc

Lorna: Could you start just by talking a little bit about your own background and how you’ve come to be working with data? Mark: I suppose my background’s different from a lot of people who do this kind of work. They often come from a maths, stats or science background, but I didn’t do A-level maths or anything like that. My first degree was politics – there was no maths in it at all. After university I got funding to do a Master’s in social research and I found that I really enjoyed the quantitative side of that, so much […]

Are Log scales appropriate for COVID-19 Charts?

You may have noticed that many media outlets are illustrating the tragic course of the coronavirus (COVID-19) pandemic by employing charts with log scales. These log values refer of course to the mathematical concept of logarithms. This is something that most of us learn about in school when we are taught that a logarithm is the power to which a number must be raised in order to get some other number. If, for example, we raise the value 10 to the power of 2, we get 100. Therefore the ‘base 10’ log of 100 is 2. If this all seems rather […]

Adding New Modules To Jython Scripting In IBM SPSS Modeler

IBM SPSS Modeler supports Python scripting using Jython, a Java[tm] implementation of the Python language. Modeler versions 16 and 17 use Jython 2.5.1 which includes a number of useful and popular modules. However, many other modules are available and customers often want to use their own so a frequent question is how to include them. There are two approaches: Copy the module to the “site-packages” folder under modeler-installation/lib/jython/Lib. This has the advantage of making modules available to anybody who uses that Modeler installation but usually requires someone with a level of administrative privileges to update the Modeler installation. Define a JYTHONPATH environment variable and […]

Using the find all() Function to search for nodes

Most SPSS Modeler scripts include code that locates an existing node e.g.: stream = modeler.script.stream() typenode = stream.findByType(“type”, None) However, some scripts need to search for all nodes – maybe by node type but also matching some other criteria. The Modeler scripting API documentation (PDF) mentions a findAll() function: d.findAll(filter, recursive): Collection filter (NodeFilter) : the node filter recursive (boolean) : if True then composite nodes should be recursively searched Returns a collection of all nodes accepted by the specified filter. If the recursive flag is True then any SuperNodes within this diagram are also searched. Unfortunately, the NodeFilter definition is not specified. NodeFilter is a base class […]

An overview of the four main approaches to predictive analytics

This infographic provides an overview of the four main families of approaches to predictive analytics. Prediction encompasses applications that aim to estimate or predict the values of a key target field. Segmentation refers to techniques such as cluster analysis which attempt to find the most ‘naturally occurring” groups within a dataset. Association modelling discovers groups of categories that are likely to co-occur such as items in a shopping basket. Forecasting refers to methods that extrapolate time trends such as sales of products so businesses can anticipate future demand. Each family is further detailed with colour coded examples of the popular […]

Using SPSS Modeler’s cache_compression setting to speed up your modelling

There are a number of configuration settings associated with IBM SPSS Modeler Server that control its behaviour. The default settings aim to ensure that stream execution will complete successfully even if the host machine is being used by a number of other applications i.e. Modeler Server is trying to be a “good citizen”. However, if Modeler Server is the primary application on the host, then tweaking these settings can reduce the execution times of some streams significantly. One of these settings is cache_compression. The cache_compression setting is used to control whether data that gets spilled to disk is compressed before being written to […]

Expert insight: Gertrude Sai, Quantitative Manager, Girl Effect

Gertrude Sai is Quantitative Manager, Evidence and Insights, at Girl Effect. Lorna: Can you start off by telling me a bit about your background and how you came to be where you are now? Gertrude: Yes, sure. My background is quite varied but mainly analytical. My degree in Psychology was definitely centered around statistics and research. My third-year dissertation project, which was fairly quantitative, was published and that really cemented my love of research and data analysis. Related to that, I’ve always had an inherent interest of working with vulnerable groups and young people, so once I left university I […]

Expert insight: Hanna Adeyinka, Customer Researcher, Hyde Housing

Lorna: Can you start by telling me something about how you came to be working with statistics and data? Hanna: I’ve always been interested in the psychology of why people do things and that led me to studying psychology at A-level, for my undergraduate degree and for my masters as well. Whilst doing my undergraduate degree, I also did a placement working for Goldsmiths University doing work as a research assistant. I really enjoyed that so when I finished my masters I looked for jobs in psychology, market research and similar areas and pretty soon I was offered a job […]

Expert insight: Inna Yordanova, Senior Researcher at IPSE

Inna Yordanova is Senior Researcher at IPSE – the Association of Independent Professionals and the Self-Employed. IPSE is the largest organisation representing freelancers and self-employed people. Its 78,000 members are freelancers, contractors, consultants and other self-employed people from all sectors of the economy. Lorna: Can you start off then just by telling me a little bit about your own background and how you’ve come to be working with data? Inna: Yes, sure. I did my undergraduate in politics and international relations and we had a couple of modules using statistics and SPSS. From there I started developing a passion for […]

What ever happened to Data Collection Reports for Surveys?

The good news is, it is a product that is still very much alive and in development, albeit it has had a long history of ownership and name changes! Back in the mists of time Data Collection Reports for Surveys was a staple component of the SPSS Market Research suite of tools. When the company SPSS and all its analytical software tools were acquired by IBM back in 2009 the full suite of tools were rebranded and Data Collection Reports for Surveys became IBM SPSS Survey Reporter. Arguably an improvement on its previous moniker which was a bit of a […]

Expert insight – Adam O’Shaughnessy, SBD Automotive

Through independent research, evaluation and strategic consulting support, SBD Automotive helps vehicle manufacturers and their partners create autonomous, more secure and better connected cars. Adam O’Shaughnessy is a Senior Specialist – Connected Car.  Lorna: Can you tell me a little bit about your background and how you’ve come to be working with data and statistics and so on? Adam: My degree was in mechanical engineering. There’s obviously a fair amount of data analysis there. After I left university, I joined SBD Automotive – a market research and technical consulting firm that operates in the automotive sector. The head office is […]

Expert insight: Rob Woods, Analytics Solution Architect/Data Scientist, Watson FSS

Rob Woods has worked in the analytics industry for over 20 years. He’s currently an Analytics Solutions Architect working on IBM’s Watson FSS suite of products. All views here are his own and not IBM’s. Describe your own background and how you came to be working with statistics / data / analytics I started as a university lecturer and research assistant in the early 1990s working with econometrics and GIS software. When I look back on it now, we were focussing on areas which are now widely accepted as important work but at the time were seen as pure research […]

Choosing a predictive analytics project

At Smart Vision we’re in a pretty strong position to talk authoritatively about the reality of predictive analytics. That’s because we’re comprised of a team of veteran practitioners with decades of experience where we’ve all witnessed plenty of success stories but also one or two ‘data science’ train wrecks. Moreover, like anyone else, we’re exposed to the seemingly constant torrent of stories about the latest developments in machine learning, data science or AI. But we’re often struck by the fact that there seems to be such a focus on emphasising the power of analytics or on explaining how machine learning […]

Statistics in court: the story of a dataset

Like a lot of consultants working in the analytics industry, I’ve built up an extensive portfolio of materials to illustrate different kinds of applications and approaches. Some of these consist of files and slide decks used to explain quite esoteric procedures such as TURF analysis or Partial Least Squares. However, there are certain materials that can be used to demonstrate such a wide number of statistical and predictive analytics techniques, that I’ve found myself immediately reaching for them again and again over the years. One of these is the SPSS Statistics sample dataset ‘Employee data.sav’. Most statistical software programs come […]

What’s new in IBM SPSS Statistics v26?

In April of this year, IBM released the latest version of SPSS Statistics. Version 26 introduces a number of additional analysis procedures as well as new command enhancements. If you’re an existing SPSS user and you’d like to upgrade to v26 there’s more information about how to do that here. If you’re interested in trying SPSS Statistics for the first time then do please get in touch – we’ll be happy to help.  New analytical procedures Quantile Regression In standard ‘least squares’ regression the model predictions are based on a single regression line. This line can be used to estimate the […]

Expert insight: Clifford Budge, Head of Ecommerce Data Science, major toy manufacturer

Lorna: Please could you start just by talking a little bit about your own background and how you’ve come to be working in data? Cliff: I went to university to do a mapping science degree, during which time I had a year out in industry. I worked as a surveyor for a company that was laying the cables for the first optical fibre telecommunications network in the UK. Within about six weeks of starting the job, I got access to the marketing data and thought I could use my mapping skills to create a visual representation of the sales and […]

I work for an analytics company, but I don’t want to talk about analytics

Here is an interesting confession. I work for an analytics company but I would really rather not think about or talk about analytics. Let me explain. I once worked with an operations director. He had a great team of analysts. He valued their work and was interested in the information they gave him but the mention of algorithms or spreadsheets made his eyes glaze over. When I met him for the first time he happened to be in the room where we were meeting his team. The technically-minded contingent quickly got caught up in fast-paced conversation. There was a feeling […]