MMHE project

2nd Meeting
Kellokoski – Finland (May 2008)

WP 5
LOUREIRO, Isabel; GOMES, José Carlos

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)
 Project aims Wider audience

What are the aims of our project? Who else need to Know ab

Management action
What is our methodology?
Institutionalization

Expected outcomes How will we keep the results moving?

What are the expected outcomes?

Communication
Who needs to know about the results an
Research performance indicators
What indicators will we measure?

Research performance Feedback for adaptative

management
Quality assuranceindicators evaluation
Quality control

Data collection
Are we getting the data we need?

Data management
Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)
How will the results be recorded and stored?
 What are the aims of our project?
• To collect available data of a set of 31 structural
indicators of social and environmental factors having
impact on the positive mental health of the 17 European
regions and their 13 national health authorities.
• To produce a practical contribution of a window of
indicators for environmental factors, to be opened in
ECHI
• To produce a report with 17 regional contributions with
the data collected
• To produce a semi-structured questionnaire about
strategic planning as well as policy implementation and
policy analysis in mental health promotion, and
• To conduct a comparative mental health promotion
policy analysis in these regions with the data gathered.
Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)
 Methodology

• Have we a methodological
problem?

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

 What are the expected outcomes?
• Data on 31 indicators…
• 17 regional reports…
• Report based on collected data…
• Increased common understanding…
• Didactic manual…
• Template…
• Promotion policies thought Europe…
• Translation in four different European
Languages…
• Dissemination plan…

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

 What indicators will we
measure?

STEP
4

STEP 1 STEP 2 STEP 3 STEP

4

STEP
4

Research performance indicators

Research evaluation
performance indicators
Research evaluation
performance
indicators
evaluation
Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)
 Step 1
• Key areas are identified and reviewed
• Meta analysis reports from research done on the
past 20 years about each defined indicator are
completed
• Semi structured interview is prepared with the
involvement of all institutions involved on the
project
• Internet site is created to fulfil dissemination and
contact needs between all the researchers and
stakeholders involved

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

 Step 2
• Identification and contacts with stakeholders related with
the studied environments. Inclusion criteria will be
previously discussed on a research team meeting. Meta
analysis report must be provide to each of them
• Characterization of the studied regions completed
(based on the defined indicators);
• Characterization of the population’s mental health on the
studied regions completed; ( both characterizations must
be done on a multidimensional and multi professional
approach)
• Translation available in 5 other languages

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

 Step 3
• Identification and analysis of mental health promotion
plans of each region (Objectives, community
involvement, expected results, financial issues, level of
intervention: local, regional or national). This
identification is achieved thought the analysis of semi
structured interviews (recorded) and local, regional or
national legislation.
• Statistical analysis of all collected data to reinforce the
relevance of the indicators (evidence-based)
• And the effectiveness of mental health promotion plans

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

 Step 4
• Report about comparative situation of these 17 regions
according with the collected data and interviews are
completed
• Papers are ready for publication in peer review
publications (in at least 4 different EU languages)
• Final report
• Conferences are prepared and celebrate in at least 4
different countries (conferences are prepared to aim
academic environments and local or regional
governments, i.e., stakeholders involved in public health
policies)
• Summer course for European students, academics and
heath politicians “monitoring of mental health
environments” is realized in one of the countries involved
in the project with the collaboration via internet of the
other partners, using the internet site of the project
Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)
 Research performance indicators
evaluation
Key areas are identified and
reviewed

Meta analysis reports from research

done on the past 20 years about
each defined indicator are
completed
Didactic manual
Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)
 Research performance indicators
evaluation
Semi structured interview is
prepared with the involvement of all
institutions involved on the project

Internet site is created to fulfil

dissemination and contact needs
between all the researchers and
stakeholders involved

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Data collection – The problem
• A Very difficult task.
• Unable to get an acceptable percentage of
answers.
• Unable to get all the information required.

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Data collection – The problem
Country Nuts 1 Nuts 2 Nuts 3 Stakeholders Answers %
Portugal Continente (PT 1) Lisboa Península de Setubal 4 1 25,0
(PT 172) (PT 172)
Italy Sud (IT F) Basilicata 5 0 0,0
(IT F5)
Nord-est (IT D) Veneto (IT D3) Verona (IT D31) 4 0 0,0
Spain Noroeste (ES 2) Pais Vasco (ES 21) 2 1 50,0
Este (Es 5) Cataluña (Es 51) 5 1 20,0
France Sud-ouest (FR 6) Aquitaine (FR 61) Pyrénées-Atlantique 3 1 33,3
(FR 615)
UK Northeast (England) (UK C) 3 1 33,3

Southeast (England) (UK J) 1 1 100,0

Northwest (England) (UK D) 1 1 100,0
Ireland Ireland (IE 0) Southern and Eastern Dublin (IE 021) 1 1 100,0
IE 02
Slovenia Slovenija (SI 0) Vzhodna Slovenija Podnavska (SI 012) 4 1 25,0
(SI 01)
Germany Berlim (DE 3) Berlim (DE 30) Berlin (DE 300) 2 2 100,0
Suomi/ Nanner-Suomi Lansi-Suomi Pohjanmaa 6 1 16,7
Finland (FI 1) FI 19 (FI 195)
Poland Region Poludniowy (Pl 2) Maloploskie (PL 21) 1 1 100,0
Macedónia EU Eastern border country 1 0 0,0

Kazakistan EU Eastern border country 1 1 100,0

TurKy EU Eastern border country 1 0 0,0
Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)
Ukraine EU Eastern border country 1 0 0,0
croatia EU Eastern border country 1 0 0,0
Data collection – The problem
• Are the regions comparable?
• 3 nuts Level 1
• 4 nuts Level 2
• 7 nuts Level 3
• …in 14 European regions.

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Data collection – The problem
• “It is extremely difficult to get information on
mental health from a precise region or sub-
region in Portugal.”
• “In general, in what concerns mental health
issues, the available information is mainly
directed to mental disorder rather than to
positive mental health(…). Besides, there has
been more investment (in particular through
social services) directed towards people with
mental deficiency/mental retardation than to
people with mental illness.”
Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)
Data collection – The problem

• “Many questions were left not answered, either

“unknown” answers (associated with lack of
data) or because some of them are not directly
related with mental health (8.5, 8.6, …)”
• “More time would be needed to allow several
contacts and search to get an accurate answer.
Others are very specific and results are not
easily accessible (4.6, 6.1, 6.2, 7.1, 8.4, …).”

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

 Data collection
Searching for a solution…

Rebuilt the questionnaire?

Get data from other sources?

• Direct interviews?
• Search for data availability on statistical
organizations across Europe (Eurostat? national
statistic institutes?)
• Identifying the gaps on mental health information
Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)
 Data management
• www.mmhe.eu
• Data stored on our web page
• Actualization information on a two month
base

That means that we must find

a way to talk with each other
on a phone conference every two months

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

 Feedback for adaptative
management
Data analysis of opinions about our web
page (quantitative and qualitative analysis)

Can we think about…

• … having a different final set of indicators?
• … including results from small surveys in
these 17 European regions? How?

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

 Communication
• 17 regional reports
• Report about comparative situation of these 17 regions
• Papers in peer review publications (in at least 4 different
EU languages)
• Conferences in at least 4 different countries
(conferences are prepared to aim academic
environments and local or regional governments, i.e.,
stakeholders involved in public health policies)
• Summer course for European students, academics and
heath politicians “monitoring of mental health
environments” is realized in one of the countries involved
in the project with the collaboration via internet of the
other partners, using the internet site of the project

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

 Institutionalization
• European Community Health Indicators
(ECHI)
• www.mmhe.eu – How can we keep our
web page working until institutionalization?

Is this an interesting question

that deserves an answer?

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

 Wider audience
• “Monitoring Mental Health Environments”
web page translated in 5 languages:
• Finnish
• Deutsch
• Portuguese
• Slovene
• Spanish

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

 Quality assurance in research
• The system witch provides guidelines
and advice to assure the quality of the
processes used in research .
(University of Reading, 2006)

• The overall management system

witch include the organization,
planning, data collection, quality
control, documentation, evaluation,
and reporting activities of the group.
(Patrick O’Connor, 2008)

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

 Quality control
• The routine technical activities
that are essentially in place to
control error. (Patrick O’Connor, 2008)

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

 Next step

Research performance indicators

• Identification and contacts with stakeholders related with
the studied environments. Meta analysis report must be
provide to each of them
• Characterization of the studied regions completed
(based on the defined indicators);
• Characterization of the population’s mental health on the
studied regions completed; ( both characterizations must
be done on a multidimensional and multi professional
approach)
• Translation in other 5 languages of the web page is
completed

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)